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"A STUDY OF SELECTED PARTICIPANTS AND NON-PARTICIPANTS 
IN A PROGRAM DIRECTED TOWARD THE DEVELOPMENT 
OF INITIATIVE AND GOOD CITIZENSHIP* 
JOHN A. BATH 
lowa State College 
INTRODUCTION 
A great deal of material has found its place in the educational literature pertaining to ways 
and means of carrying on citizenship and leadership training as a part of, or in conjunction with, 
the school program. Unfortunately, very little has been done in the way of evaluation of programs 


pointed toward such training. The present study was an attempt to make an evaluation of a specific 
which was designed to encourage and develop those traits which, in a broad sense, were 








HOW IS GOOD CITIZENSHIP DEVELOPED? 


The development of good citizens has always been one of the foremost objectives of educa- 
in the United States. Ways of attaining this objective have long been a matter of some differ- 


opinion both among school people and the lay citizenry. Some contend that the develop- 
good citizenship can best be brought about through a broad educational program in the 
. This influence has been seen in recent years in the general trend toward diversification 
curriculum, providing more extensive activities in both the academic and non-academic 
areas. Others believe such training can be provided more completely through some special type 
@program. Such programs are not always a required part of the school experience of every 
child but they are commonly sponsored by, and operated in conjunction with, the schools. 


h’ahan! found that whereas civics courses were the chief curricular means of getting at the 
problem of citizenship, actually they fell far short of the goal. As a measure of the value of such 
tourses he attempted to determine the specific characteristics of citizenship by asking 280 repre- 
Sentative citizens to name the duties, difficulties and qualities of a good citizen. When he can- 
vassed 350 high school students, who had had a course in civics, for their opinions regarding the 
Garacteristics named by the adult citizens, there was little relationship. 


Training for citizenship is frequently interpreted in a restricted sense as helping the indi- 
Vidual to discover, evaluate and put into action such practices as are deemed to show allegiance to 
one’s country. A much broader interpretation would suggest that, in addition to the above, what- 
@ver society as a whole considers to be the desirable qualities to be possessed by its members the 

of those traits is a part of training for citizenship. Generally speaking it is the latter 
iaterpretation which the school e of America have chosen in building their programs of citi- 
tenship. The comment of Bonser“, although made several years ago, reflects what seems to be 
the accepted notion today of the school’s part in this training. He says: 


‘Citizenship means personal responsibility for the well-being of all as well as 
opportunity for personal freedom in doing whatever is desirable providing this does 
not interfere with the equal freedom of anyone else. It means restraint as well as 
liberty.’’ 
*This study was done under the direction of D. A. Worcester, University of Nebraska. 
Vhomas Jefferson Mahan, sis of the eristics of Citizenship (New York: Teachers 
College, Columbia University, 1928). 


SS. ©. sonser, Elementary Schoo} Curriculum (New York: ‘The Macmillan Company, 1921), p. 39% 
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Others have suggested that the principal purpose for which citizenship training is provided 
is the development of constructive leadership or followership. By far the greater emphasis has 
been placed upon producing leaders. The activities of the schools have tended to place the empha- 
sis in this direction. Jones3, in writing about the education of youth for leadership, expresses the 
following reaction: 


‘‘---we cannot escape the conclusion that in our schools as now constituted 
there are appreciable numbers of potential leaders--a far larger proportion than 
ever achieve real leadership in later life. This represents an incalculable loss to 
society, a loss that can be materially reduced if the proper measures are taken.’’ 


It is not quite clear from Jones’ statement whether he charges the schools with failure to 
ferret out their potential leaders or whether he is suggesting that society has failed to provide 
sufficient opportunities in order that the potential leaders can develop. Whatever the interpre- 
tation, there is no mistake about the importance which he attaches to the schools’ responsibility 
for development of leadership. An examination of the literature on citizenship provides much sup- 
port for Jones’ position. 


Typical evidence that considerable attention is being paid to the part school programs play 
in citizenship development is found in the publication of the Educational Policies Commission, 
Learning the Ways of Democracy.4 The Commission reports the survey made of ninety American 
secondary schools for evidence of democratic citizenship. A description is provided of numerous 
situations in which these schools are carrying on activities designed to equip students at the high 
school level for helpful citizenship in the community. 


Mahan made an extensive study of the characteristics of citizenship. After reviewing defi- 
nitions of good citizens and citizenship supplied by several of the nation’s leading educators he 
concluded: 


‘*The school is considered to be one of the most important agencies for pro- 
ducing good citizens. It is the task of the school to determine first of all what are 


the characteristics of good citizenship, and then to select such traits as should be 
taught by the schools in order that it may train in those socially desirable activities 
--those duties which all individuals are called upon, in their lives as citizens of a 
democracy, to perform.’’ 


Traits of the so-called good citizen are legion. Although there might be some uniformity in 
agreement as to what the most important traits are, there would surely be disagreement as to the 
rank order of their importance. Such a situation suggests that school authorities are left more or 
less to their own discretion in determining how the separate components of citizenship are to be 
provided to best advantage in the school program. However, there are numerous studies on what 
constitutes citizenship together with suggestions for ways of developing it. 


It would seem, then, there is general agreement that citizenship training should hold an im- 
portant place in the school program, Separate programs which are intended to reach beyond the 
usual bounds of citizenship and provide training in a host of related traits have found a place in 
numerous school systems. Many such programs have been carried on under the assumption that 
they are valuable additions to the school program. Many have become mechanical in their method 
of operation and few attempts have been made to evaluate their procedures or outcomes. 


In the total survey of iseraturs the one study which is most like the present one in problem 
and procedure is that of Courtenay.” She was interested in determining to what degree leadership 
persists into post-high-school years. She used the technique of paired groups of women, One 

hundred members of the leadership group had gained distinction during their high school career by 

Sarthur J. Jones, The Education of Youth for Leadership (New York: MoGraw-Hill Book Co., Inc., 
1938), p. 27. 

“Educational Policies Commission, Learning the Ways of Democracy (Washington, D.C.: National 
Education Association, 1940). 

Thomas Jefferson Mahan, Op. Cit., p. 3. 


Svery Ethel Courtenay, “The Persistence of Leadership", Schoo} Review, XLVI (1938), pp. 97-107. 
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their leadership activities; the control group was composed of a similar number who had evinced 
interest and cooperation in the affairs of the school community but had held no important positions 
of leadership. The graduates were those of a single high school between the years 1922 and 1934. 
Those in the leader group had established their claim to distinction as leaders by merit of having 
peen elected to the senior girls’ council. The election was the result of the vote of the entire sen- 
ior class with the approval of a faculty committee. The council, limited to eighteen girls, was 
largely responsible for the administration of girls’ interests in the school. Pairings were made on 
the basis of socio-economic background, ethnic heritage, scholarship rating and age at graduation. 
The data were collected by means of questionnaires and investigation of high school records. 


Briefly, the findings of the study were these: (1) the leadership exhibited in early years had 
a definite tendency to persist, (2) the averages of activity and distinction through major offices and 
special nonors for the leaders and non-leaders in high schools stand in the relation of 7.9 to 0.9, 
(3) a similar relationship for those in both’groups who continued their study in institutions of high- 
er education is expressed by averages of 5.5 and 1.5, (4) in the community life of post-school years 
the leadership of the two groups assumed a ratio of 4.7 to 1.1. 


THE PURPOSE OF THE PRESENT STUDY 


For purposes of this study it is not necessary to set down in so many words the definition of 
a good citizen. The activities engaged in by the participants in the program under study represent 
what the builders of the program considered important to the development and encouragement of 
habits which would result in good citizenship. Instead of questioning whether these activities are 
the ones rated as most important by the experts the plan was to measure something of the perma- 
nence of the traits reputed to have been employed. 


The subjects of this study were students who had had an opportunity to participate in a spe- 
cial program designed to develop citizenship characteristics. The program is known as the Effi- 
ciency Program. It developed as one phase of the Junior Civic and Industrial League which is the 
self-governing body of the junior high schools of Lincoln, Nebraska. 


PLAN OF THE EFFICIENCY PROGRAM 


Broadly speaking the Efficiency Program is intended to develop and encourage initiative and 
good citizenship in junior high school girls and boys. It was originally started in the upper ele- 
mentary grades, but following the establishment of Junior high schools in Lincoln its operation was 
restricted to that unit of the school organization. The Program, having undergone changes from 
time to time, had been operating in the Lincoln junior high schools for twenty-eight years when this 
study was made. It is only that phase of the Junior Civic and Industrial League known as the Effi- 
ciency Program with which this study was concerned. The Chamber of Commerce (formerly the 
Commercial Club) and the junior high schools of the city have sponsored jointly the Efficiency 
Program. 


In a bulletin which explained the plan of the Efficiency Program, M. C. Lefler, Superintend- 
ent of the Lincoln Public Schools, made the following statement: 


‘*The suggestions contained in this bulletin are intended to stimulate and en- 
courage individual initiative on the part of junior high school boys and girls. 

‘‘A wide range of worthy activities provides for the differing interests of junior 
high school pupils, and enables them to give free expression in the direction of their 
needs, abilities and aptitudes. Efficiency, as here intended does not imply a high de- 
gree of polish, but rather clear-cut evidence of developing traits. Industry, initiative, 
enthusiasm and integrity are regarded as fundamental characteristics. Of course, 
matters affecting health and physical fitness are of primary importance. 

‘Worthy citizenship and heipful community service are constant goals of each 
school. The efficiency program emphasizes these aims and provides a means of 
discovering and training the boys and girls of each junior high school to assume 
active leadership in the school and community.” 


The Efficiency Program is introduced to the pupils upon their entering the junior high school 
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in the seventh grade. A pupil, in order to secure an efficiency certificate, should have been a 
member of the Lincoln Junior High Schools three semesters. However, a pupil who enters before 
the close of the six-weeks period in Grade 9-B may be permitted to earn a certificate upon recom- 
mendation of the school principal and with the approval of the Director of the Bureau of Child Wel- 


fare. 


Following were the requirements for the efficiency certificate at the time of this investiga- 
tion: 


1. Credit must be earned in 30 units listed under Activities with not more than five credits 
in any one of the ten major divisions, one of which must be in certain health activities. (The ten 
major divisions of activities are: health-safety; school leadership; school service; citizenship; 
community service; industry, vocations and civic information; fine arts; special interests; practi- 
cal arts; group participation.) 


The majority of the activities which are outlined are in connection with the school program, 
but several home and community activities are also included. No credit is awarded for an activity 
in which school credit is earned. Homeroom teachers, principals, sponsors of activities and 
teachers or directors of special activities are responsible for deciding whether credit shall be 
granted. If credit is granted it is so indicated by the teacher in charge recording the grade, date 
and her initials opposite the activity on the activity record. Recommendation for credit may even 
come from the parent in rare instances. In all, about 150 different activities are listed through 
which efficiency credit may be earned. Typical of some of the activities through which efficiency 
credit may be earned are the following: (1) posture, (2) chairman of a committee from a class or 
a club, (3) classroom assistant, (4) a member of an election board, (5) upkeep of public property, 
(6) savings and investment plan, (7) writing a play, (8) first place awards at state fair, 4-H club, 
hobby shows, etc., (9) personal account system indicating wise use of money, and (10) member of a 
homeroom team. Definite standards were established for each activity and credit for the activity 
must be judged and authorized by the sponsor, a classroom teacher, a homeroom teacher, princi- 
pal or other responsible person. 


2. In addition to the activity requirements, the pupil must meet an achievement standard on 
an individual basis equal to or greater than his estimated learning ability based on a chart provid- 
ed by the Department of Measurements and Research. That standard must be maintained three out 
of the last four semesters. 


3. Certain character trait ratings are required. A pupil must twice be rated by his home- 
room and classroom teachers. Three-fourths of his ratings for the semester must be ‘‘plus’’ or 
‘*satisfactory,’’ with not more than half of the ratings on any one trait being ‘‘minus.’’ (A ‘‘plus”’ 
rating indicates especially good development of a trait; a rating of ‘‘s’’ stands for satisfactory de- 
velopment of a trait; ‘‘minus’”’ indicates need for improvement of the trait.) The first rating of 
character must be made at the close of Grade 8A, with a provisional rating at 9B and the final ra- 
ting in 9A. Smoking automatically disqualifies a pupil. 


4. An additional requirement is that a letter must be written by the pupil to the Superintend- 
ent of Schools and to the Secretary of the Chamber of Commerce on a subject of civic interest. 


5. Final approval for the efficiency certificate is made by the Director of the Bureau of Child 
Welfare. 


GENERAL PLAN OF THE STUDY 


As mentioned earlier, the technique of matching was applied in this study. Individuals from 
two groups who had been awarded an efficiency certificate were paired with individuals from two 
groups who had not been awarded such a certificate. It seemed advisable to study two different 
groups of efficiency and non-efficiency persons in order to note what changes, if any, had been 
demonstrated in outcomes of the program over a period of two decades. One group of individuals 
was selected from the four eighth-grade promotion groups for the school years 1921-1922 and 
1922-1923, and another group from the promotion groups of three junior high schools in June, 1941. 
Because the junior high school organization was not yet complete at the time the older group was in 
elementary school, certificates were issued at the conclusion of the eighth grade. At that time, 
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most of the efficiency activities were in Grades 7 and 8 with a few extending down into the 6th 
grade. Individuals of the younger matched groups were awarded efficiency at the close of the 
junior high school period, over which period of time they had opportunity to meet the necessary 
requirements. 


Throughout the remainder of this study the 1921-1922 and 1922-1923 graduates will be desig- 
nated as Groups 0; and O2 (the older group). The 1941 groups will be referred to as Groups Yj 
and Yg (the younger group). In both the younger and older groups, the subscript ‘‘1’’ identifies 
those who were awarded efficiency certificates while subscript ‘‘2’’ identifies those not receiving 
the certificate. 


PLAN OF MATCHING FOR OLDER GROUPS 


The principal basis on which matchings were made were (1) year of promotion from eighth 
grade (within a two-year span), (2) sex, and (3) school marks earned in Grades 7 and 8. 


Only men who were still living in Lincoln were matched for the study of this older group. 
Such a restriction seemed advisable for three reasons. First, since personal interview was be- 
lieved to be the only satisfactory method of gathering much of the data, it was necessary to restrict 
the investigation to subjects yet living in Lincoln. Second, the problem of locating the girls, the 
majority of whom would have been married, would have been most difficult because of change in 
names. Third, much of the information used for evaluation purposes was related to the individual’s 
occupation. Inasmuch as many of the girls, following marriage, would have confined their attention 
largely to housekeeping duties with varying opportunities for participating in civic affairs, inclu- 
sion of girls did not appear to be advisable for the purposes of this study. 


While grades were the best single means by which the individuals could be matched, the num- 
ber of pairs that could be made was quite limited in view of the close matching used. A scale of 
grades for the Group O2 individuals ran considerably lower on the average than did those of the 
Group O; individuals. For the sixty men from the four promotion groups who were still living in 
Lincoln, a satisfactory match could be found for only eighteen. That is to say that the grades for 
the remaining forty-two were enough higher than any in the Og Group as to make further pairing 
inadvisable. 


While socio-economic status and age are frequently included as bases on which matched pairs 
of individuals are formed, neither was included in this study. Rather, the investigator was inter- 
ested in discovering whether these factors were causative in obtaining an efficiency certificate. 
This would not have been possible had such bases been included. 


SOURCES OF INFORMATION RELATIVE TO GROUPS 0; AND O2 


A variety of sources was investigated in an attempt to get as complete information as possi- 
ble about the subjects in the older group. These sources included (1) school records, (2) Lincoln 
city directory, (3) personal interviews, (4) teachers and principals, (5) Nebraska Credit Company, 
(6) juvenile court records, (7) municipal court records, and (8) Council of Social Agencies. 


As might be expected, the interviews provided the most illuminating information. By this 
technique such data were obtained as regards (1) amount of education, (2) number of occupations 
engaged in since leaving school, (3) unemployment, (4) marital status, (5) extent of participation in 
civic organizations, (6) church affiliations and activities, (7) financial support given to church and 
welfare organizations, and (8) recollections of the Efficiency Program. 


In addition to the data relative to past school activities, and the school records of these indi- 
viduals over that range of grades in which the Efficiency Program operated, it was believed de- 
sirable to learn something about the earlier school activities of the subjects. That is, in order to 
measure the permanent effects of the Efficiency Program it was necessary to find out what charac- 
teristics were being displayed prior to their participation in the program by those individuals who 
were awarded efficiency certificates. It was believed that how well pupils were remembered and 
what was remembered about them should be valuable information in investigating the question of 
persistence of traits. This type of information was obtained by interviewing elementary school 
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teachers and principals who were associated with the schools during the latter years of the sub- 
jects’ elementary school training period. While this information is subjective in nature, the teach- 
ers were not advised that a study was being made relative to the Efficiency Program. They were 
merely asked to recall as much information as they could pertaining to every pupil on the promo- 
tion lists of the two years under study. In addition to such evaluations as scholarship, citizenship, 
leadership and character these teachers and principals provided general impressions of their for- 
mer pupils in many other respects. 


From the Nebraska Credit Company such information was gathered as concerned present 
occupation, occupational stability, approximate income and general reputation for meeting obliga- 
tions. 


The records of both the juvenile and municipal courts were checked for evidence of instances 
of behavior which came into conflict with the law. The executive secretary of the Community 
Chest and Council of Social Agencies permitted each of the subjects to be cleared through the So- 
cial Service Exchange. 


THE PLAN OF MATCHING FOR YOUNGER SUBJECTS 


A somewhat different plan of pairing was used for the younger group. Twenty-eight pairs 
were made, each consisting of an efficiency and a non-efficiency pupil of which thirteen pairs were 
males and fifteen were females. The basis for matching, in addition to the fact that all were pro- 
moted to senior high school in June, 1941, included (1) sex, (2) race, (3) junior high school attended, 
and (4) I.Q. on the Henmon-Nelson Test of Mental Ability. 


The 28 pairs were selected from the three junior high schools which send students to Lincoln 
High School. Selections from these three schools were made only because of the convenience of 
interviewing all pupils at one high school which draws its pupils from these schools. The number 
of pairs selected from each junior high school was approximately in the same proportion as the 


number of promotions from each of these schools. 


No individual was chosen for matching purposes whose I.Q. varied more than 10 points on 
two different forms of the Henmon-Nelson Test of Menial Ability. No person was paired with an- 
other unless the average I.Q. ratings agreed within four points. Over half of the pairs either a- 
greed exactly or varied no more than one point of I.Q. 


Socio-economic status was considered in the matching only insofar as pupils were matched 
with others from the same junior high school. Although there are exceptions, each junior high 
school in this study draws from a rather different socio-economic section of the city. 


SOURCES OF INFORMATION RELATIVE TO GROUPS Y; AND Y2 


Data on the younger group were collected from three sources: (1) school records, (2) inter- 
views with subjects, and (3) interviews with former elementary school teachers of the subjects. 


The data obtained from the school records were used mainly in the matching process. How- 
ever, such information as pertains to occupations of parents was obtained from the records and 
will be cited later. 


The primary purpose of the interview with the younger individuals was to record observa- 
tions and opinions of a recent group regarding the functioning of the program. It was believed that 
this group, having been out of junior high school less than a year, would still have rather detailed 
recollections of the program, and now that the program was past history for them it was hoped that 
a free expression of opinion might be obtained. It was explained to the pupil that a study was being 
made of the Efficiency Program and that his cooperation was being solicited in this evaluation. In 
most instances merely mentioning the name Efficiency Program was sufficient to recall it to the 
pupil’s mind regardless of whether or not he had participated in it. He was assured that the infor- 
mation was confidential and he was encouraged to express his honest opinions about the program. 
Several questions were asked regularly of every subject, but each was also provided an opportunity 
for free expression in regard to the program. 





JOURNAL OF EXPERIMENTAL EDUCATION 167 


The purpose for which the elementary teachers of these individuals were interviewed was 
essentially the same as for the older group; that is, to get some subjective measurement of traits 
which the pupils were displaying prior to entrance into junior high school. In this series of inter- 
views information was obtained only for the 56 pupils rather than for the entire promotion group 
from which the paired groups were selected. However, these teachers were not told which pupils 
were awarded efficiency certificates and which ones were not so awarded. 


DATA PERTAINING TO THE OLDER EFFICIENCY AND NON-EFFICIENCY GROUPS 
(Groups O; and O2 ) 


Data from schoo} records. - Although individuals were not paired with respect to age, it was 
found that there was but one month of difference in the mean ages of individuals in Groups O; and 
at the time of promotion from the eighth grade. The mean age at promotion of O; persons was 
14-4 while that of O2 persons was 14-3. 


All but two individuals in each group lived with both parents throughout their elementary 
school period. Those four lived with the mother only. 


English was listed as the mother tongue of all but two of the O; persons and of all but one of 
the O> persons. German was the mother tongue of the two in the first instance and Italian was list- 


edas the mother tongue of the one individual in Group O02, 


The O; persons represented six different elementary schools. The Og persons came from 
ten different schools. 


Occupational status of parents of O; and O2 individuals and occupational status of the individ- 
uals of those groups. - For purposes of this study a simple scale for rating occupations, adaptable 
to use with small groups, was desired. Beckman’s’ scale appeared to meet the requirements best. 
His scale was built to indicate the rank of an occupation on the basis of the intelligence, capacity or 
skill, education and training required for its pursuit, at the same time reflecting the socio-econom- 
ic prestige attached to it. These factors are particularly useful when applied to the school situa- 
tion. All occupations in this scheme come under five main classes or grades as shown in Table I. 
This table shows the occupational ratings of parents of individuals in Groups 0; and Og at the time 
their children were finishing grade school. Inspection of the table reveals that there was little dif- 
ference between occupational ratings of parents of these two groups. What slight advantage there 
was seemed to be in favor of the O; Group. No professional, managerial, or executive occupations 
were represented for parents in either group. Likewise, the occupational ratings of the subjects in 
Groups O; and Og show only a small difference. Those in Group 0), however, ranked slightly high- 
er on the occupational scale. It is interesting to note that individuals in both Group O,; and O9 
tended to rate higher on the occupational scale than did their parents. Of all the individuals in 
Group Oj, over half were in occupations accorded a higher rating than their parents’ occupations 
in 1922 or 1923 while of the 03 Group less than half‘ranked higher in the occupational scale than 
did their parents. Only four of the O; persons and two of the O» persons were found to be follow- 
ing the same occupation as their fathers’. 


Occupational stability. - The individuals of Group O; were considerably more stable in their 
occupations than were the O2 individuals. Over one-third of the 0; Group had been engaged in the 
same occupation since leaving school, while only one-sixth of the Og Group could claim a similar 
record. Only one OQ; person had been in his present occupation fewer than five years, while that is 
true of over one-third of the O2 persons. 


Comparisons of occupational stability are shown further by the number of major jobs held 
since leaving school. A major job was considered as one in which a person was engaged a mini- 
mum of one year. In Group 0; more individuals had been engaged in a single major job than all 
other number of jobs combined. Aside from one individual in Group 0; who had held as many as 
ten jobs and another who had held five, no other individuals in this group had held more than three 
jobs. The modal number of jobs held by individuals of Group O2 was two, but only three were still 
pursuing the same work they had begun following school. In Group OQ; only one person had been un- 
employed for any considerable length of time and he for six months. Over one-third of Group O9 


™, 0. Beckman, "A New Scale for Gauging Occupational Rank", Personne] Journa], XIII (1934), 
pp. 225-233. 
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TABLE I 
OCCUPATIONAL RATINGS OF PARENTS OF SUBJECTS IN FOUR GROUPS 
AND OF THE SUBJECTS IN GROUPS 0] AND 02 


01 02 0} O2 Y Y2 
Parents Parents Group Group Parénts Parents 

- Unskilled Manual 1 0 2 0 2 
- Semi-skilled 3 2 1 6 13 
. Skilled and white 

collar 

Sub- professional 
- Professional 
- Occupation Unknown 


TOTAL 1 


TABLE 0 
ELEMENTARY SCHOOL TEACHERS’ RATINGS OF SUBJECTS IN GROUPS Y; AND Y, 


Group Y; Group Y2 Group Y1 Group Y2 

SCHOLARSHIP No. % No. % LEADERSHIP No. % No. % 
Above Average 15 54 10 36 Constructive 17 61 8 28.5 

Average 7 25 13 46.5 Destructive 0 0 2 7 

Below Average 3 10.5 a 14 None Displayed 8 28.5 17 61 
Not Reported* 3 10.5 1 3.5 Not Reported* 3 10.5 3.5 
TOTAL 100.0 28 100.0 TOTAL 28 100.0 100.0 


CITIZENSHIP GENERAL RATING 
19 68 20 71.5 Outstanding 13 46.5 25 


Average 6 21.5 2 7 Mediocre 10 36 46.5 

Poor 0 0 5 18 Unpromising 2 7 25 

Not Reported* 3 10.5 1 3.5 Not Reported* 3 10.5 3.5 
TOTAL 28 100.0 28 °# 100.0 TOTAL 28 #§=100.0 

*Not remembered by any teacher or did not attend Lincoln elementary schools. 


TABLE 
SENIOR HIGH SCHOOL TEACHERS’ CHARACTER AND LEADERSHIP RATINGS OF 
SUBJECTS AFTER ONE SEMESTER IN HIGH SCHOOL 


Superior Inferior 
Group Y1 Group Y2 Group Yj Group Y2 
11 3 2 


15 9 8 
4 5 1 
8 2 1 

38 19 12 


Constructive Destructive 
ong Yi tes in one Y1 = Y2 
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had experienced unemployment ranging from one month to two years. 


Economic status. - Yearly income in 1942 ranged from $720 to $2100 in Group Co and from 
$1200 to $3000 in Group O;. The median salary for both groups was $1800, but more persons in 
the O; Group drew larger salaries and fewer had as low salaries as individuals in Group Oj. How- 
ever, the mean salary of the persons in Group 0; and Group O9 was $1913 and $1634 respectively. 


Educational status. - The individuals of Group 0; attended school longer, one-third of them 
having been granted the B.S. degree and one having received both the A.B. and LL.B. degrees. One- 
sixth of the persons in Group Op received B.S. degrees or their equivalent and, of these, two com- 
pleted M.A. degrees. Five in Group O2 as compared with four in Group QO} left school before com- 
pleting the twelfth grade. 


Marital and family status. - All but two members of Group C, and all but three of Group 02 
were married. One person in the 0; Group had been divorced and remarried. In the O; Group the 
modal number of children was one; in the O2 Group the modal number was two. There were the 
same total number of children in each of the two groups. 


Participation in church and welfare. - Slightly less than three-fourths of the members of 
Group C1 were members of a church, whereas every individual in Group O02 was a member. Of the 
members of Group C; about half said they attended church fairly regularly but seldom contributed 
their services to the church work. About the same proportion of the members of Group Oo partici- 
pated to the same extent. Two individuals in Group O; took a very active part in church work in 
that they had responsibilities such as serving on a church board, whereas such responsibilities 
were being taken by three in the Op Group. 


Contributions of money to church and various welfare groups during 1941 indicated that mem- 
bers of Group Oj are somewhat more philanthropic. This might be expected, however, in view of 
the higher earning power of these individuals. Also their higher average occupational rank might 
have had the influence of greater pressure being brought for contributions to welfare organizations. 
The Group O, individuals’ range of contributions was from $2 to $175 with a median of $50. The 
range in Group O9 was from $1 to $65. The median was $20. Only one person in Group C9 con- 
tributed a larger amount than the median amount contributed by members of Group 0}. 


This particular sampling of individuals indicates that while 0; individuals gave more finan- 
cial support to worthy causes, the C2 persons were more likely to belong to a church and they were 
at least the equal of O,; individuals with respect to special responsibilities in the church. 


Five individuals from the O; Group and two from Group O2 had participated in drives or 
campaigns for such organizations as Community Chest, Red Cross and Salvation Army. 


Reputation for meeting financial wbiigations. - According to the ratings given by the Nebra- 
ska Credit Company, two-thirds of those in Group OQ; had a satisfactory credit rating as compared 
with half of Group Oj. An equal number in each was described as being slow in meeting financial 
obligations. Two of Group 0; and five of Group Op» individuals were described as having unsatis- 
factory credit ratings. 


Conflicts with the law. - Members of Group O; apparently had been more law-abiding than 
those of Group Oo if number of arrests is a valid index of that trait of citizenship. Twenty-two per 
cent of Group Oj had been in conflict with the law once each, whereas about thirty-nine per cent of 
Group O2 had been brought before the court. Of the latter group almost half had appeared on more 
than one charge. In each case the majority of arrests made were for traffic offenses, but in the 
latter group charges were brought for intoxication, malicious destruction of property and fraud. 


Membership and participation in civic organizations. - In post-school life, have those individ- 
uals who were awarded efficiency certificates demonstrated a sense of civic responsibility? Some 
clues to the answer to this question were sought by inquiring into membership and leadership in 
various civic organizations. Only those organizations which were usually considered as performing 
public services were included in the listing. Most of them were of the nature of service clubs. 
Lodges, unions and business or professional organizations were excluded. 


In Group Oj slightly more than one-third of the individuals, at the time the study was made, 
held memberships in civic organizations. Enough others had been members of such groups some- 
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time in the past to bring that proportion to two-thirds. Of those active at the time the data were 
gathered one-sixth had some special duty in the organization in the way of officer, board of direc- 
tors or committeeman. The tendency seemed to be for those who participated in such organiza- 
tions to be active in more than one. 


In Group O2 slightly more than one-fourth held memberships and two others had been mem- 
bers previously, so that of this group about forty per cent were participating or had participated 
in the past. Only two of this group had special duties or responsibilities in their organizations. 


ecollections of the Efficiency Program. - One measure of the value of an activity might be 
assumed to be the recollections which people have of the activity. Upon the assumption that mean- 
ingful experiences are usually retained, the investigator inquired during each interview whether 
the Efficiency Program was in operation when the subject was in school. Usually a brief descrip- 
tion was given of the activities included in the program in order to aid the subject in identifying it. 
If the subject remembered such a program he was not questioned as to whether he was awarded an 
efficiency certificate. 


The evidence gained from this sampling from both groups indicated that participation in the 
program had little effect upon remembering or not remembering it. Half of those who had re- 
ceived certificates stated definitely that no such program was in operation at the time they were 
in school. This meant of course that they did not remember having received a certificate. Of 
those persons in Group O; who remembered the program, four said that they had not received cer- 
tificates. A like number of those who rece‘ved the certificate remembered having received it. Of 
those in Group Op» about half had some recollection of such a program. An equal number could re- 
member nothing of such a program. 


The effect of prohibiting smoking. - It will be recalled that no boy who smoked was entitled 
to an efficiency certificate even though he met all other requirements. Since the purpose of sucha 
rule was to discourage smoking, an effort was made to determine whether or not the habit was 
present when the study was made. It was found that only two persons in each group did not smoke. 


Apparently such a rule was not effective in discouraging 


Social service exchange and juvenile court records, - Investigation of the records of the ju- 
venile court revealed that none of the individuals in either group had ever been brought before that 


court. 


The clearing of names through the Social Service Exchange revealed that in only one instance 
was help given which was on a relief basis. ‘rhis was for a person in Group Oo, but was of minor 
significance inasmuch as the aid provided was for a short period of time. 


Teachers’ recollections of former pupils. - In order to obtain evidence relative to the kind 
of individuals the subjects were prior to their introduction to the Program, interviews were held 
with former elementary teachers and principals of all pupils in the four promotion groups from 
which individuals were selected for this study. 





Although principals and teachers in ten different schools were interviewed, it was not possi- 
ble to obtain information for every pupil in every school because in a few instances no teacher or 
principal was available when the data were gathered who taught in those particular schools. The 
teachers, at the time of the interview, were unaware that comparisons were to be made later with 
respect to people who had earned or had not earned an efficiency certificate. 


From the ratings which teachers provided relative to scholarship, leadership, citizenship 
and character plus other comments which they frequently made in providing a more complete de- 
scription of former pupils, ratings were assigned by the writer to those who, from the descrip- 
tions, appeared to merit ratings as outstanding individuals. Of the entire list, tabulations were 
made to determine which were and which were not later awarded efficiency certificates. In every 
instance a considerably larger percentage of Group O01 than Group O2 pupils were remembered as 
being outstanding. Also a tabulation was made of the numbers from both groups who were not re- 
membered by their teachers. With only two exceptions a larger percentage of O9 than O; pupils 
were forgotten. 


These data for the promotion groups were further analyzed with respect to the pairs of indi- 
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viduals with whom a detailed study was being made. The contrast between the two groups was 
marked. All but one of the O; pupils were remembered as having displayed leadership in grade 
school. On the other hand only one of the Op persons was remembered as a leader. 


Almost three times as many of the individuals in Group O; as those in Group Op» had been 
good citizens in grade school as judged by their teachers and principals. Only one of Group O, as 
compared with four of Group O29 were judged as having been poor citizens. Every O; pupil was re- 
membered as having been of good character, whereas three of Group O29 were judged as having 
been of poor character. 


These data provide evidence that QO; persons as 3 group were exhibiting those traits as- 
sumed as necessary for the efficiency award before their participation in the program, 


DATA PERTAINING TO THE YOUNGER EFFICIENCY AND NON-EFFICIENCY GROUPS 
( Groups Y; and Yo ) 


Thirteen pairs of boys and fifteen pairs of girls who were promoted from three Lincoln 
Junior High Schools in June, 1941, were the subjects for this phase of the study. Data were gather- 
ed from three sources, namely (1) school records, (2) interviews with the pupils, and (3) inter- 
views with the former elementary school teachers of these pupils. 


Data obtained from schoo) records. - As was the case with the older groups, school records 
for the younger group were used mainly for matching the pairs of individuals. As mentioned 
earlier, the available data from this source revealed that for the older group, the efficiency per- 
sons were older by one month than the non-efficiency pupils. In the case of the younger groups the 
findings were reversed. On the average, individuals of Group Y2 were two months olderthan those 
in Group Yj. It appears that this difference was not great enough to suggest that the age factor had 
any influence upon whether or not a pupil earned an efficiency certificate. 


While it was more usual than not for there to be a difference in the occupational rark of par- 
ents, this difference for any given pair tended to be a small difference. The data in regard to par- 
ents’ occupational rank is summarized in Table I. As in the case of the older group, Beckman’ s8 
scheme for determining occupational rank was used. 


What differences there were in occupational grade of parent tended to be in favor of Group 
Y,. Exceptions were that for one pair the occupation of the parent of the Y2 pupil ranked two 
grades higher; in four other pairs there was a difference of one grade in favor of the parent of the 
Yo pupil. For eight pairs the occupational rank of parents agreed exactly. In fifteen pairs the ad- 
vantage was in favor of parents of Y; pupils, ranging from one grade to three grades higher. There 
were twice as many parents of pupils in Group Y, whose occupational rating was either grade four 
or five (sub-professional and professional occupations) as there were in the same two grades in 
Group Yg. There were no Grade 1 (lowest ranking) occupations for parents of Group Y;, and less 
than half as many in Grade 2 occupations as was found for parents in Group Y2. 


Interview data. - The pupils interviewed were sophomores in Lincoln High School and at the 
time of the interviews had completed a semester of high school work. 


After something of the purpose of the interview had been explained the pupil was asked if he 
had participated in the Efficiency Program and whether of not he was awarded a certificate. This 
question was followed by asking why each had or had not worked for the certificate. 


A variety of reasons were given by members of Group Y; why they had worked for the cer- 
tificate, and an almost equal number of reasons were given by members of Group Y2 why they had 
not worked for the certificate. In order of frequency of response the following reasons were given 
by Group Yj: (1) honor, (2) valuable in later life, (3) goal to work toward, considered part of work, 
and influence of brother, sister or friends, (4) influence of parents, and (5) popular thing to do. 
Three reasons are given under number three above since each of these was listed an equal number 
of times by the interviewees. 


®2. 0, Beckman, Op. Cit. 
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In reviewing the reasons given by Group Y92 it seemed that in some few instances there was a 
tendency for the pupil to rationalize. It was difficult to tell in all sintances whether the pupil was 
completely reassured that he was not being criticized for having failed to earn a certificate. Many 
of the responses were conventional reasons given for failing to participate in a given activity. In 
this instance it seemed natural that the student might have tended to give an easy explanation for 
his failure to work for a certificate, such as not being interested in the project. In order of fre- 
quency of response to this question the following reasons were given: (1) not interested, (2) tried, 
but had too few credits, (3) believed it was not worthwhile, (4) did not investigate the program, (5) 
lost interest, and (6) the work was too hard or unfair. 


The most outstanding impression which the investigator gained from the conference was the 
lack of information which these pupils had about the Efficiency Program. Several of those in Group 
Y2 admitted that they knew very little about the activities in the program or how it operated, and 
many of the pupils in Group Yj did not understand very well the principles on which the program 
operated. But they did recall that it was necessary to acquire 30 credits in order to be awarded a 
certificate. 


Extent to which program encouraged new activities, - An activity program is usually as- 
sumed to be creditable because it either encourages new activities or perhaps helps to direct old 
activiites in a more meaningful manner. The program is intended to encourage initiative on the 
part of junior high school boys and girls. The information gained through the interviews throws 


some light upon such a supposition. 


Approximately two-thirds of the individuals in both groups reported their belief that the effi- 
ciency program caused pupils to do only a limited number of things which they would not have done 
otherwise. About one-eighth of the pupils believed the program caused one to pursue numerous 
new activities. Nearly one-fifth of the two groups said credits were earned almost wholly by pur- 
suing the usual activities. 


Even though there is much variety in the plan of activities in the Efficiency Program, and a 


given number of credits must be earned in each group of activities, the above findings seem to in- 
dicate that in the majority of cases pupils earned credit doing the things they think they would have 
done anyway had such a program not been in operation. 


Closely related to the question discussed above was one which was directed only to the indi- 
viduals in Group Y;. Each was asked how much extra effort he expended working for a certificate. 
Over half reported ‘‘slight’’ or in similar descriptive terms. 


Students’ estimates of value of the efficiency program, - As might be expected, more indi- 
viduals in Group Y, than those in Group Y2 estimated the value of the program in such terms as 
‘‘considerable.’’ However, a majority of the pupils in Group Y2 also believed it had considerable 
value. Six in Group Y2 assigned no credit whatsoever to the program, while only one in Group Y} 
made such a statement. Such a response might be expected in view of the fact that those in Group 
Y2 may not have earned a certificate because they did not try for credits and therefore might not 


have been qualified to judge the value of the program. 


In addition to providing a general judgment of the value of the program the subjects were 
asked to enumerate specific values. Many of the suggested values were so general as to be mean- 
ingless. Pupils had considcrable difficulty, for example, in explaining what they meant by ‘‘it 
makes you more efficient.’’ There was considerable tendency for a pupil to recall certain require- 
ments when suggesting values. The person who suggested ‘‘it causes a person to maintain better 
posture’’ had probably been impressed by the stress placed upon this particular item in the health 
group. Those who suggested that ‘‘it encourages one to keep up his grades’’ were most likley 
thinking specifically of the requirement that pupils must work up to their estimated learning ability. 


The stated purposes of the program -- encouragement of initiative, leadership and citizen- 
ship -- were mentioned by several in a variety of ways. If initiative implies a motivating force, 
then the development of initiative would rank number one among the values suggested. Fully half 
of the values suggested were in the nature of incentives although only one person suggested that the 
program encouraged initiative as such. Not one mentioned leadership as such, but six suggested 
that one learns to handle responsibility. Four said participation encouraged good citizenship and it 
was noted that, taken together, most of the other reasons implied good citizenship. One interesting 
observation is the fact that two people in Group Y2 suggested that participation in the program 
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should help in deciding upon a vocation. This value was not given by any person in Group Yj. This 
is a bit surprising inasmuch as one of the ten groups of activities in which credit may be earned 
refers to industry, vocations and civic information. 


Weaknesses in the program suggested by the pupils. - Those who had been awarded efficien- 
cy certificates were most critical of the program. The explanation for this may lie in the fact that 
those who were awarded certificates had more experience with the program on which to base their 
comments. On the other hand, those who lacked a few credits of having enough for efficiency may 
have hesitated to express their honest criticisms for fear their comments would be used in some 


way against them. 


The criticism that credits were too easy to earn was given most often. Rating second among 
weaknesses was the charge that insufficient information was provided early in the junior high 
school period about the program. Many times a pupil got well along in his school program before 
he learned what the program was about. Aside from these two criticisms the remainder were di- 
verse in nature and, in some cases, it appeared that the reasons given almost amounted to pet 
peeves on the part of the individual concerned. Although other criticisms were mentioned by one 
or two individuals they probably should not be regarded as unimportant since they furnish addition- 
al clues as to pupils’ feelings about such a program. Following are additional comments made re- 
garding weaknesses of the program: 


- Pupils should be reminded of its activities more often to avoid last minute 
rush to earn credits. 


Same standard is not maintained by all teachers in judging whether credit 
should be given. 


- Pupils too often chosen for a task because they needed credit in that par- 
ticular area. 


. Creates jealousy between those working for efficiency and those not work- 
ing for it. 


There should be more things that everyone can do. 
- The activities should be linked more closely with the school. 
A set number of credits should not be required in every area. 
Opportunities to pass some tests should not be restricted to one trial. 
- Program just isn’t appealing. 


Letters to the superintendent of schools and to the secretary of the chamber 
of commerce should be the original work of the pupil. 


Pupils are not encouraged to earn more than the required number of credits. 


The number of credits should be reduced and those left should be made more 
difficult. 


Credit is not always restricted to things done during junior high school. 
Credit should not be given for work that is an honor to perform. 
Credits are too easy. 

Pupils’ report of work done is frequently accepted without investigation. 
Teachers push certain students; others are forgotten. 
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Elementary schoo] teachers’ ratings. - As in the case of the older group an answer was 
sought to the question whether those qualities of a pupil which the efficiency certificate is consid- 
ered to represent were being exhibited prior to participation in the program. To get a partial an- 
swer to this question teachers and principals of the pupils concerned were interviewed. 


The fifty-six pupils in the younger group had attended twelve elementary schools. As far as 
possible, teachers were interviewed who had these pupils in Grades V and VI. Since it is the usual 
practice to have more than one teacher for a given grade it was often necessary to contact two or 
more teachers in each school. ‘Information was obtained from twenty-three teachers and principals. 
As was the practice in the case of the older group, teachers did not refer to records but provided a 
brief description of each child as he was remembered. 


Table II is a summary of the data obtained from these twenty-three teachers and principals. 
Information was obtained for twenty-five of those in Group Y, and for twenty-seven of those in 
Group Y9 out of a total of twenty-eight in each group. One pupil in Group Y) was not remembered 
by any teacher contacted, possibly because frequent moves on the part of this pupil made it diffi- 
cult for a teacher to form a lasting impression. Information could not be obtained for the other two 
two in Group Y) and for one in Group Y2 because they did not enter the Lincoln schools until Grade 


VII. 


While scholarship has been found to be an important trait of leaders, it probably is not as im- 
portant in this study as those traits and actions which describe a person’s display of civic respon- 
sibility. It is interesting to note, however, that although individuals were matched for general in- 
telligence, the persons in Group Y, had apparently made better use of this aptitude as judged by 
the ratings in scholarship given by the elementary teachers. It is also possible that the halo effect 
was operating here. 


From the standpoint of leadership over twice as many of Group Y; as of Group Y2 were ex- 
hibiting that trait in elementary school. None in Group Y; were rated as destructive leaders. Over 
twice as many in Group Y2 as in Group Yj had failed to display leadership of any type. 


Ratings as good citizens were about equal for the two groups. There were none rated as poor 
citizens in Group Y,1 but five in Group Y2 were so rated. 


The general rating appearing in Table II represents a composite of scholarship, leadership 
and citizenship ratings. This subjective rating was arrived at by taking those pupils who had rank- 
ed above average in scholarship, constructive in leadership and good in citizenship and classifying 
them as outstanding for a general rating. Likewise, those who ranked average in scholarship and 
average in citizenship were given a mediocre general rating, and so forth. The general rating of 
outstanding shows approximately a two to one ratio in favor of Group Y;. A few more of Group Y2 
than Y; were rated as mediocre, but over three times as many Y2 aS Y1 were rated as showing 
little promise for developing into a good citizen by the elementary teachers. 


Senior high schoo) character and leadership records, - As mentioned previously the pupils in 
this phase of the study had been in Lincoln High School for one semester, long enough to have re- 
ceived one rating on traits of character and leadership. The traits upon which high school teachers 
rated their pupils are indicated in Table II]. A report was not made by a teacher if an average dis- 
play of any given trait was exhibited. Only superior and inferior ratings are made on the four 
traits of character and ratings of constructive and destructive on leadership. 


A comparison between the totals for the two groups shows an advantage in every trait with 
the exception of honesty for those in Group be - Exactly twice as many ratings of superior were 


given to those of Group Y; as of Group Y2, w four times as many in Y2 as in Y; were given 


ratings of inferior in the character traits. 


It should be noted that very few ratings on leadership were given. This is likely due to the 
fact that, having been in high school only one semester, there had been insufficient opportunity to 
display leadership characteristics for a rating to be given by a teacher. It is possible that the ra- 
tings for a single semester do not properly indicate the trend of differences between the groups 
since a period of adjustment is necessary for most pupils upon entering high school. Whether the 
adjustment problems for both groups would be the same in intensity is difficult to say, but on the 
basis of past performance one would judge that Group Y,; should be more capable of rapid adjust- 
ment. If this is true, the ratings at the end of the first semester would tend to be a more accurate 
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measure for Group Y, than for Group Y2- But it must be remembered that, on the average, Yj 
people had demonstrated traits in elementary school which distinguished them as the more prom- 


ising individuals. 


SUMMARY 


1. A majority of pupils who were awarded efficiency certificates had already demonstrated 
outstanding qualities of leadership and citizenship in elementary school. 


2. Those awarded efficiency certificates were superior to those not so rewarded in the ma- 
jority of respects in which comparisons were made. They had better jobs, were more stable in 
their occupations, had a better reputation for meeting their financial obligations, came into con- 
flict with the law less frequently, contributed more to church and welfare organizations and contin- 
ued their education longer. 


3. The rule prohibiting those who smoked from receiving a certificate did not result in ab- 
stinence from the habit in later life.” 


4. As judged by recollections of the program on the part of those who had been awarded cer- 
tificates twenty years prior to the investigation, the program activities did not leave lasting im- 
pressions. 


5. The occupational rank of parents of the two older groups investigated differed but little. 
Parents of the younger groups showed a difference of almost one full grade on an occupational ra- 
ting scale in favor of parents of efficiency award recipients. 


6. The general feeling amongst members of the younger groups was that the Efficiency Pro- 
gram was valuable. Nevertheless, they were quite critical of its operation. Two-thirds of the sub- 
jects believed the Program caused pupils to engage in only a limited number of activities which 
they would not have engaged in otherwise. To them, it seemed more a matter of reporting activi- 
ties engaged in and seeing that credit was recorded. 


CONCLUSION 


While the results of this study show that, in general, those persons who were awarded effi- 
ciency certificates were more responsible citizens, the differences between the efficiency and non- 
efficiency groups were not particularly outstanding. If it had been possible to match pairs even 
more closely, considering such factors as family income, home training, companions, siblings, 
language spoken in the home and amount of travel differences might have been even less significant. 
Perhaps the greatest value which results from a program such as the one under study here is the 
incentive which it furnishes to the pupil to enlarge the scope of his experiences and to achieve gen- 
erally on a higher level. It is important to note that those who participated in this program and 
who were awarded an efficiency certificate, generally speaking, had exhibited earlier in iife the 
traits the Program was designed to develop. 


It is the belief of the writer that the general technique of evaluation as employed in this study 
might be used with profit in evaluating other programs purported to develop initiative and desirable | 
citizenship traits. 


"Disqualification for the efficiency award because of smoking has been eliminated since this study 
was made, 





TESTING FOR GRADE AND SCHOOL DIFFERENCES AMONG 
THE SCORES OF HOME ECONOMICS STUDENTS 


WILLIAM DOWELL BATEN HAZEL M. HATCHER 


Brooklyn College. Pennsylvania State College. 
Brooklyn. N. Y. State College. Pa. 


The purpose of this analysis is to determine (a) whether or not there is a significant differ- 
ence in the academic achievement of eleventh and twelfth grade students in the same homemaking 
class and (b) the variability of schools with respect to such a difference. A four-week unit in con- 
sumer buying was taught at the senior high school level in four schools in St. Paul and Minneapolis, 
The objectives for the unit were agreed upon by the teachers who participated and the same method 
was followed throughout; that is, the teachers and pupils together decided how best to work toward 
their objectives and together checked pupil accomplishment as the unit progressed. Different types 
of evaluation were used such as a pencil-and-paper test, diaries, case studies and anecdotal rec- 
ords but this analysis is based upon the pencil-and-paper test which proved to have a reliability of 
-91 when used as the final examination for 250 students. 


Table I contains the scores made by the eleventh and twelfth grade students in the four con- 
sumer buying classes, together with their I.Q. scores. An ordinary analysis of covariance is not 
sufficient for analyzing these data, since there were not the same numbers of eleventh and twelfth 
grade students in each class. To give proper weights to the averages made by the students in the 
different schools and grades it is necessary to fit constants to the data.1 


Let it be assumed that the score of any student depends upon the grade and school she is in 
and upon her I.Q. Let - G represent the effect of being in the eleventh grade (the effect of being 
lees mature than twelfth grade girls), + G be the effect of being in the twelfth grade and let 8), S 9) 

S83, and S4 represent respectively the effects of the four schools. Let b be the regression coeffic- 
ient pertaining to the I.Q. and the final score in the course. Let Yijk Tepresent the score of the 
k th.student in the i th grade and in the j th school. According to these assumptions 


(1) Vig = * G + 8; + bxgy + Baye 
Where Xijx 1s the 1.Q. of the ai atetes > Os Se ane Oe be eeee ee Se we 


responding residual error which cannot be attributed to grade, school or I.Q. The sign of G is 


minus if the girl is in the eleventh grade and plus if in the twelfth. 
The sum of the squares of the residual errors is 
(2) EB = (Yiye 5 G - 8; - bxyyy)?, 


where the summation takes in the final scores of all students. This assumption indicates that 
interaction, grade x schools, is negligible. By minimizing the sum of the squares of the residual 
errors the following six simultaneous equations arise 


(3) 111G+ 38,+ 138 - 4S, + %S, + 2,325b = 875 
3G+ 318; + 082 + 083 + 084 + 3,233b = 1,082 

13 G+ 08;+ 4182+ 083 + 084 + 4,465b= 1,611 

-4 G+ 081 + 0S2+ 1883+ 084 + 1,918b = 679 

9 G 081 + 082 + 0S3 + 2184 + 2,337b = 903 
2,325 G+ 3,23381 + 4,46582 + 1,91883 + 2,33784 + 1,295,099b = 463,247 


These equations may be solved directly for the values of G, 8), 85, 83, 84; and b or as will 
now be explained. Let the following six equations in the unknowns C11, C42, C13, Cy4, Cy5> Cig: 


1g, W. Snedecor, and Gertrude M. Coz, 
Classification, Research Bulletin No. 160 (Ames, Iowa: Lowa State College). 


—_—— SS 
FP. Yates, "The Principles of Orthogonality and Confounding in Replicated Experiments ," Journal of 
Agrioultural Science, XXIII (1933), p. 108. 
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TABLE I 


The I.Q. scores and scores made by eleventh and twelfth grade girls in home economic 
classes in four high schools. (X = I.Q. scores, Y = home economics scores.) 
Eleventh Grade Twelfth Grade 








Schools Schools 





B B 
































a 





be written 
(4) 11104; + 3Ci2+ 13C 43 - 4Ci4+ 9Ci5+ 2,325C 1 = 1. 
8Cy,+ SIC yg + =—§ OC ye = Oy = OH + = 3,233, 4 = 0. 
1344 + 0Ci2+ 41Ci3+ 0Ci4* OCis+ 4,465C 1 = 0. 
-4Ci1+ 0Ci2+ 0C 13+ 18C14+ 0C15 + 1,918C 1g = 0. 
9Ci,+ 0C 12+ 0Ci3+ OCi4* 21Ci5 + 2,337C 16 = 0. 
2,325C 1, + 3,233C 12* 4,465C ., + 1,918C 4 + 2,337C .. + 1,295,099C .¢ = 0. 


It will be noticed that the coefficients in equations (4) are the same as the coefficients in equations 
(3) and that the constant terms in the right hand members of equations (3) have been respectively 
replaced by 1, 0, 0, 0, 0, 0. The solution of equations (4) gives values of C;;, C12, Ci3, C4, Cis, 
and C;g- Another set of six simultaneous equations can be set up in the unknowns C21, C22, C23, 
Coq, Cog, and Cog by using the coefficients in equations (3) and the constants in (3) respectively 
replaced by 0, 1, 0, 0, 0, 0. Another set can be set up in the unknowns C31» C32> C33, Coq, Cg5, 
and Cyg by using the coefficients in (3) and the constants 0, 0, 1, 0, 0, 0. Similarly a set in C4, 
C42, C43, Cag, Cas, and Cgg, a set in C5; and a set in Cg, (where i runs from 1 to 6). These six 
sets of simultaneous equations in six unknowns were solved with the following results: 
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C11 C12 C13 Ci4 Ci5 Cig 
.009’825'071'98, .002’031°89727, - .000’000'649'28, .005’230'845’34, .001'027'965’75, - .000’028’600'07 


C21 C22 C23 C24 C25 C26 
.002’031"897°27, 1.536’879'909’07, 1.570"723'041'07, 1.53'7'955"350"61, 1.604’885’074’31, -.014'429'128'54 


C31 C32 C33 C34 C35 C36 
-.000°000'649'28, 1.570°723'041'07, 1.664’576'798'08, 1.604°839'647'93, 1.676’081'282’59, - .015'061'061'66 


C41 C42 C43 C44 C45 C46 
.005’230°845'34, 1.537'955’350’61, 1.604’839'647'93, 1.628'595'607'01, 1.639’413'825’14, - .014°751°719'03 


C51 C52 C53 C54 C55 C56 
-.001’027'965'75, 1.604°885’074'31, 1.676’081'282’59, 1.639°413'825'14, 1.760’488'012’32, -.015'387'675’09 


C61 Cé2 C63 C64 Cés Cé6 
-.000’028'600'07, .014’429°128'54, .015°061'061'66, - .014’751°719'03, - .015’387’675'09, .000'138'381'93 


R. A. Fisher (1) has shown that G, Sj, S2, S3, Sq, and b can be found from the C’s. These 


values are 
G = 875C 4; + 1,082C 9 + 1,611C3, + 679C 4) + 903C 5; + 463,247C 6) 


Sj = 875C); + 1,082C 9; + 1,611C3; + 679C 4; —., + CHANG, 
b = 87516 + 1,082C 5 + 1,611Cg¢_ + 679C 4, + 903C 5 + 463,247C 56 


where j takes values from 2 to 5. When these relations are employed the following values are ob- 


tained for the unknowns in equations (3) 
G = .168'999'924’88, S, = 4.349'187'285’50, So = 7.350’ 872’582’84, 


S3 = 6.558’867'618’55, Sq = 10.341'466’602'45, b = ..292’813’623’28 


The reduction in the sum of the squares of the scores of the students about the mean of all 
scores which is due to the fitting of the constants, G, S$}, So, Sg, Sq and b is found from part of the 
Standard error of estimate of the scores about the linear relation (1). This reduction is found as 


follows: _ 
(D.F.)O e? =X (¥ - ¥)? - 875G - 1,0828; - 1611S, - 67983 - 9038, - 463,247 


(D.F.)O 2 = £ 4,591.73 - 1,487.43, 


where (D.F.) represents the degrees of freedom in the expression for the standard error of esti- 
mate and ©, is the standard error of estimate. The reduction is the sum of squares due to 
grades, schools and regression coefficient is 1487.43. This quantity enables us to find the sum of 
squares due to the interaction of grades and schools. The following table shows this interaction 


sum of squares: 


TABLE 0 


Analysis of covariance of final scores in these homemaking classes. 





Source of SS of 
variations D.F. SS(X) SS(XY) SS(Y) | estimate| D.F. 


Total 110 | 7,943.96 | 2894.98 | 4591.73 | 3536.79 








Between 
classes 1,129.80 838.00 891.88 


Within 
classes-error 6,814.16 | 2056.98 | 3699.85 | 3078.91 





Betweeh 
classes 








457.88 
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The error sum of square after taking out the effect of differences between classes and 
1.Q’s is 3,078.91 as found in the sixth column in the error line in Table II. This quantity is the re- 
mainder after the sums of squares due to grades, interaction of grades and schools, schools, and 
regression pertaining to I.Q.’s have been taken from the total sum of squares of scores. The dif- 
ference between this quantity and the total sum of square 4,591.73 is 1,512.88, this is the totality of 
the sum of squares of the effects of grades, schools, interaction of grades and schools and I.Q. 
The sumeof squares due to the constants G, 81, S89, Sg, S84 and b is 1487.43 which does not include 
the sum of squares due the interaction of grades and schools. The difference between these last 
two values is 25.39 and is the sum of squares due to the interaction of grades and schools. 


The sum of squares due to the differences between school means is found by fitting to the 
data constants pertaining to grades and regression concerning I.Q.’s. In this case the score of the 
h th student in the i th grade is 


(5) Yay = 84+ b’xyy + yy where i = 11 and 12. 


By the method of least squares 

611 = -.861'401'255, gy9 = --053’440'912, b’ = .361'188'836. 
The reduction in the total sum of squares due to grades and I.Q.’s is 

811 (1,700) + gy2 (2,575) + b (463,247)"= 1,072.38. 
Since the reduction in the total sum of squares due to grades, schools and I.Q.’s was found to be 
1487.43 the difference between 1487.43 and 1072.38 = 415.05, is the sum of squares due to schools 
when allowances are made for different sizes of classes and I.Q.’s. 


The sum of squares due to the differences between grades is found by fitting to the data con- 
stants pertaining to schools and regression concerning I.Q.’s. In this case the score of the k th 
student in the j th school is 


(6) Vik = 8; +b’’x+ jk 


where j = 1, 2, 3, 4. 


By the method of least squares 
s’ = 4.314’192’897, sb = 7.350'886'101, s = 6.468’781’650, 


b’’ = .293'306’53S, 84 = 10.359'153’018. 


The reduction in the total sum of squares due to schools and regression pertaining to I1.Q.’s is 
8’; (1,082) + 8’ (1,611) + 8’ (679) + S’4 (903) + b’’(463,249) 


= 1,484.97. 
The difference between 1487.43 and 1484.97 = 2.46 and is the sum of squares due to grades 


when allowances for different sizes of classes and I.Q.’s are made. Table II contains the final 
analysis of variance of these data. 


TABLE I . 


‘pene pen Hoan res of the students _ 
Source of variation . 8S of estimate | Mean Square 


Between grades 2.46 2.46 








Between schools 415.05 138.35 


Interaction-GxSch. 25.39 8.46 




















Error 3,078.91 30,18 
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According to Table III there is no significant difference between the eleventh grade and the 
twelfth grade averages. This means that the eleventh grade girls do about as well in these home 
economics classes as the twelfth grade girls. There is a significant difference between at least 
two school averages. The F-value in Table II for schools, 4.58, indicates that differences be- 
tween school averages are highly significant. 


R. A. Fisher” has shown that the variance of the differences d = 81-5; is 
Via) = [ Cy - 2Cy + Cor, 
where V represents variance and@2 is the error mean square in Table III. The variance of 
d= sj - s4, is 
Vid) =[ Coo - 2Ca5 + C55 _) 30.18 
= [[ 1.536’879"909'07 - 2(1.604’885’074’31) + 1.760’488’012’32] 30.18 
= 2.626. 


The t-value for this difference is 
: 4.349’ 187285’ - 10.341'466’602 _ 3 72 
EE 





which shows that the girls in school D are superior to those in school A. Differences between 
other school averages can be tested similarly. 


SUMMARY 


This article has. shown how to analyze data when the numbers in the ‘‘cells’’ or classes are 
not the same. This was accomplished by fitting constants to the data. This statistical technique 
showed that eleventh grade girls were about as good in home economics courses as twelfth grade 
girls and that there were significant differences between schools. These school differences may 
have been largely due to teacher differences. 


2p. A. Fisher, Statistical Methods for Research Workers, 4th Edition (Edinburgh: Oliver and Boyd, 
1932). 





GENERAL AND SPECIFIC FACTORS IN READING COMPREHENSION 


A. STERL ARTLEY 
University of Missouri 


It is axiomatic to state that reading is one of the chief avenues to learning in American 
schools. During the last decade school practitioners and research workers have evidenced an in- 
creasing awareness of the nature and extent of the reading problem. A great deal of this attention 
has been directed to the problem of the development of the reading skills, habits, and attitudes es- 
sential to successful participation in the several content areas of both the elementary and second- 
ary curricula. 


In general, school policies in relation to the provision made for the development of these 
basic or work-type reading skills have varied between two points of view. At the one end of the 
continuum is the point of view that the basic reading skills are general in nature, and, as a result, 
should be developed by the reading or English teacher. At the other end is the point of view that 
these skills are specific in nature and should be developed under the guidance of the ‘‘subject’’ or 
content area teacher. Between these extreme points of view lies another which holds that the basic 
skills are both general and specific, and that the reading or English teacher is vested with the re- 
sponsibility for developing the basic or generalized skills, abilities, and attitudes, while the other 
teachers are charged with the responsibility of applying to their specific content area those basic 
language learnings, as well as developing those skills, abilities, etc. that seem uniquely related to 
their own instructional field. 


Certain basic assumptions which may or may not be entirely valid underlie each of these 
points of view. Those who hold to the first assume that the factors which make for reading com- 
prehension are general, and by virtue of that fact, are common to several areas. Hence, ‘‘ability 
to organize’’, for example, is generic, and, accordingly, one who is able to organize in terms of 
the main and subordinate points in fifth grade geography would be able to carry on equally well 
when he crossed the hall to his science class. As a result reading instruction may be effectively 
provided in a class designed to develop these general skills. 


Likewise, those who hold the belief that reading skills are specific in nature assume that 
the reading pattern varies with the content areas, as well as to the purposes for which one compre- 
hends within that area. In other words, this assumption would lead us to believe that history, for 
example, has its own constellation of factors that make for successful comprehension, while chem- 
istry might have another group. Moreover, the fact that one ability appears to apply to several 
content fields, may mean that it is alike in name only; functionally it may be entirely different. 
This would mean that the particular ability could hardly be developed and made to operate effec- 
tively in one area as a result of instruction given in another. Neither would we be justified in test- 
ing for the presence or absence of this skill in a particular content field by a test that was designed 
to measure ‘‘general comprehension’’. 


Those who hold to the merits of the approach that both general and specific reading instruc- 
tion have a place in the functional program do so on the assumption that there may be less differ- 
ence in the reading abilities themselves than in the difference to which students transfer these 
abilities from one content field to another. Said another way, there may be less difference between 
the ability to interpret seventh grade history and seventh grade math, for example, than there is in 
the extent to which pupils transfer this ability from the place where instruction is given to the 
place where the skill is to be used. Consequently, each teacher is accountable for making the nec- 
essary application of this ‘‘generalized’’ ability to his particular area. 


Several Gieces of research provide clues as to the validity of the assumptions mentioned 


above. Shores, + working with a group of ninth grade children, made a study of the skills involved 
in the ability to read history and science. He found that the ability t» read sceince materials re- 
lated in a significant manner to such factors as science vocabulary, general vocabulary, ability 


\James H. Shores, The Ability to Read Historical Materials as Related to Bighth-Grade Achiev 


and General Reading Ability (unpublished Master's thesis, University of Minnesota, 19358). 
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to read graphs, charts, and tables, and the ability to understand details. In like manner he found 
certain factors such as paragraph comprehension, understanding of details, and grasp of total 
meaning entering into the ability to read history materials. He also compared the skills involved 
in the reading of these two basic subjects with those required in reading literary type materials, 
and found that neither was significantly related to the latter. Shores concluded that ‘‘by the time 
students have reached the ninth grade, reading proficiency is to a considerable extent specific to 
the content field in which the reading is done. To speak of general reading ability of ninth grade 
students without description of the content field in which reading is done is unwarranted... The 
ability to read scientific and historical materials holds unique and different relationships to a num- 
ber of reading skills.’’ 


Treacy,2 using seventh graders, studied the relationship of reading skills to the ability to 
solve arithmetic problems. By comparing good achievers in arithmetical problem solving with the 
poor achievers he found the former superior to the latter in the specific abilities that might be pre- 
sumed to enter into this specialized area, while no region of significance was found in those abili- 
ties that are of general nature such as reading to predict outcomes, knowledge of general informa- 
tion and ability to recognize the central thought of a paragraph. Treacy concluded that in helping 
pupils through reading instruction to improve their ability to solve arithmetical problems ‘‘reading 
should be regarded as a composite of specialized skills rather than as a generalized ability.’’ 


These and other studies® undertaken along a similar line give an indication that the ability 
to engage successfully in a particular subject matter area is contingent to some degree upon skills 
that may be the same or similar to those found in another area. To a larger degree, however, is 
the ability to comprehend dependent upon abilities that are unique to the field studied. 


With light as indicated above upon the problem of specific and general factors in reading 
comprehension several supplementary issues present themselves. In the first place we have the 
question of the extent to which general and specific factors enter into ultimate achievement in each 
content field. Obviously if achievement in general science or geography is contingent largely upon 
the skills related to general reading comprehension, then there is little need to be concerned with 
the development of the more specialized skills, regardless of their relation to the more general- 
ized ones. Uf, on the other hand, achievement requires an application of the abilities that can be 
developed effectively only within the confines of a particular content field, the responsibility of 
each teacher in relation to instruction in reading becomes clear and specific. 


Providing there is a specificity in factors in reading comprehension, a third problem arises. 
That is, what reading skills and abilities are related to adequate comprehension in each subject- 
matter area, and what is the relative order of their importance? It is apparent that the answer to 
this question is imperative if each teacher is to deal adequately with the reading that is a part of 


the subject being taught. 


2yohn P. Treacy, "The Relationship of Reading Skills to the Ability to Solve Arithmetic Problems,” 
Journal of Educational Research, IXXVIII (October, 1944), pp. 86-96. 


3Elden Bond, Tenth Grade Abilities and Achievement, Contributions to Education, No. 813 (New York: 
Teachers College, Columbia University, 1940). 


Eva Bond, Reading and Ninth Grade Achievement, Contributions to Education, No. 756 (New York: 
Teachers College, Columbia University, 1938). 


Joseph Dewey, “The Acquisition of Pacts as a Measure of Reading Comprehension,” Elementary School 
Journal, XXXV (January, 1935), pp. 346-48. 





B, T. Ritter, and ®. T. Lofland, "The Relation Between Reading Ability as Measured by Certain 
Standardized Tests and the Ability Required in the Interpretation of Printed Matter Involving 


Reason,” Elementary Schoo} Journal, XXIV (March, 1924), pp. 529-46. 


Bsther Swenson, The Relation of Ability to Read Material of the Type Used in Stud Science to 
Eighth Grade Achievement (Unpublished Master's thesis, University of Minnesota, 1938). 
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To provide further understanding on the problem of general and specific factors in reading 
comprehension, as well as to throw light upon the two supplementary issues mentioned above, the 
writer undertook a study of the relationships that existed between general reading comprehension 
and reading comprehension in a specific subject matter area as one means of providing a basis for 
allocating the responsibilities related to the development of effective reading and study abilities. 
In brief, these three purposes stood out: 


1. To determine the relationship between scores on tests purporting to measure abilities 
related to comprehension in a specific subject-matter area and scores on a test designed to meas- 
ure a more general type of reading comprehension. 


2. To determine the extent to which reading comprehension of both the general and specific 
types enters into an informational type of achievement in a specific subject-matter area. 


3. To determine the relative importance of certain factors assumed to be components of 
reading comprehension in a specific subject-matter area. 


PROCEDURES USED IN THE STUDY 


Because the field of social studies is such a vital one in general education, and because 
more nearly adequate research instruments appeared to be available for the purpose of the investi- 
gation, this field was selected for study. Data were secured by means of a series of tests apprais- 
ing achievement in general reading comprehension, certain aspects of reading comprehension in 
the social studies, and informational achievement in the social studies. The tests used are listed 


below: 


I. General reading comprehension-Cooperative Test Service, English Test Cl: 

Reading Comprehension, Form Q, purporting to measure 

1. General vocabulary 

2. Speed of comprehension 

3. Level of comprehension 
Certain aspects of reading comprehension in the social studies- Progressive 
Education Association, Application of Principles in Social Studies, 1.5, pur- 
porting to measure: 

1. Ability to see logical relations 

2. Ability to evaluate arguments 
Cooperative Test Service, Test of Social Studies Abilities, Experimental 
Form Q, purporting to measure: 

1. Knowledge of sources 

2. Ability to organize 

3. Ability to interpret 

4. Ability to apply generalizations 
Cooperative Test Service, Test of General Proficiency in the Field of Social) 
Studies, Form QR, (Terms and concepts subtests only) 

. Informational achievement in the social studies-Cooperative Test Service, 


Survey Test in the Social Studies, Form O, purporting to measure ‘‘achieve- 
ment of a topical content nature in the several social studies areas.’’ 





These tests, requiring a total testing time of approximately five hours per pupil, were ad- 
ministered to 242 eleventh grade pupils in a typical eastern high school. Complete data were se- 
cured for 200 cases, and all computations were made on this basis. By subjecting the data to sta- 
tistical analysis which provided coefficients of correlation and partial regression coefficients, find- 
ings were secured which are summarized below: 


SUMMARY OF FINDINGS 


1. A coefficient of correlation of .79 was found to exist between the measures of reading 
comprehension of a specific nature and general reading comprehension. This was reduced to .75 
when the effect of intelligence was partialled out. 


2. The contributions to informational achievement in the social studies of a team composed 
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of general and specific reading comprehension are indicated in the following beta weights (partial 
regression coefficients in standard score form): 


general reading comprehension - .410 
specific reading comprehension-_ .401 


3. The relative importance of certain factors assumed to be components of reading com- 
prehension in the social studies are indicated in the beta weights presented below: 


social studies vocabulary... 

general reading vocabulary... 

ability to interpret ...... .. 

ability to obtain facts 

ability to organize ......... 

ability to perceive logical relations ... 
ability to apply generalizations 

ability to evaluate arguments 


CONCLUSIONS 
Within the limitations of the study, the following conclusions appear to be valid: 
1. The extent of relationship that exists between tests of general reading comprehension 
and reading comprehension in a specific subject-matter area makes it appear that, in general, abil- 


ity to read material of a general informative type is associated with the ability to read a type of 
material more directly related to a specific content area. 


2. The absence of a near perfect correlation between measures of general and specific 
reading comprehension provides evidence that there exists a high degree of specificity in the fac- 


tors relating to reading comprehension in a specific subject-matter area. 


3. The abilities measured by tests of general and specific reading comprehension appear to 
be present to an equal extent on an informative test of achievement in the social studies. 


4. A knowledge of word meanings of both a general and specific nature, the ability to inter- 
pret, to obtain facts, and to organize appear to contribute most to the ability to comprehend social 


studies material. 


EDUCATIONAL IMPLICATIONS 


On the basis of the conclusions presented above, several pertinent educational implications 
may be made. In the first place, the reading teacher or the teacher invested with the responsi- 
bility of caring for the reading needs of pupils may make a material contribution toward giving a 
type of training that will operate in a functional manner in the social studies field, at least. More- 
over, every classroom teacher has the direct responsibility for developing those reading skills and 
abilities essential for adequate comprehension within his particular area of instruction. This is in 
addition to applying to his content field and making functional those skills and abilities being devel- 
oped by teachers in other areas of instruction. 


One should not be misled by the apparent high correlation of .78 between the measures of 
general and specific reading comprehension. In interpreting any coefficient of correlation, one 
should keep in mind the purpose for which the r is computed. An r computed for the purpose of 
merely determining the degree of commonality between two factors is quite different in interpre- 
tation from the same r when it is to be used for predictive purposes, for in the latter situation the 
relation between the two factors must be a great deal higher than in the former. Though for this 
case the r is not computed for the purpose of prediction, a similar interpretation should be made. 
That is, we are interested in knowing how well a particular pupil will be able to achieve on a test d 
comprehension in a specific area when his achievement is known on a test of general reading com- 
prehension, and vice versa. One way of interpreting a coefficient of correlation is by its ‘‘fore- 
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casting efficiency’’ or coefficient of dependability (E).4 When one applies the formula for E, the 
efficiency of the obtained r is found to be .387 per cent. In other words, either measure (general 
or specific reading comprehension) is less than .50 per cent efficient in predicting scores on the 
other measure. Hence, one may conclude that though the correlation between scores on the two 
factors ‘s sufficient to say that a high degree of commonality exists between them, it is not high 
enough to dismiss the possibility that there are a great number of pupils in the distrilution who 
might profit from g specific type of reading instruction. 


The intercorrelations between the measures of the several factors presumed to be compon- 
ents of reading comprehension (ability to obtain facts, ability to evaluate arguments, ability to in- 
terpret, etc.) in the subject-matter area studied indicated positive though moderately low relation- 
ships. Among the eight factors under consideration the r’s extended between .275 and .785 with 
only several over .60. In other words, though the factors are positively related, possessing the 
ability to organize, for example, does not necessarily infer a high degree of ability to perceive 
logical relations or to evaluate arguments. This fact holds several implications of significance to 
the test maker and to the test user. First, it makes it appear that an adequate test of reading com- 
prehension should be one that requires a number cf different types of responses. That is, the test 
should appraise a number of different abilities rather than one or several, as is the practice of 
many tests. For example, in a survey-type test such abilities asthe following should be evaluated: 
ability to infer, ability to organize, ability to select the main idea in a paragraph or longer selec- 
tion, ability to select important details, ability to judge the relevancy ci material, and the like. It 
is apparent that such an appraisal would be an attempt to get at the thinking side of reading -- a 
consideration receiving much recognition by those who are concerned with the semantic implica- 


tions of reading. 


In the second place, there appears to be a definite need for reading tests that place more 
emphasis upon diagnosis. It it not enough to say that a pupil comprehends thus and so in general, 
but rather, that he comprehends well or poorly in history, literature, or algebra. Such a demand 
necessitates a delineation of the reading purposes or abilities essential for adequate comprehan- 
sion in each area of experience, and then the construction of tests or subtests that will appraise 
growth and achievement in these specific abilities. Knowing, for example, that adequate compre- 
hension in history requires the abilities, among others, of securing information, of organizing data, 
af interpreting findings, and of understanding the specialized concepts and terms, permits one to 
devise an instrument that will appraise strengths and weaknesses. These strengths can then be 
translated into pupil needs, which, in turn, furnish the basis for adequate instruction. 


This study provides, at least, one technique for determining the skills that are essential to 
achievement in a particular content area. Other procedures might be those of using expert opin- 
ion, or of analyzing assignments, texts, workbooks, manuals, etc. for the specific skills demanded. 
It would be assumed that to the extent to which all three approaches were used, the more nearly 
adequate the list would be. However, the implication is clear to all content area teachers that they 
must be aware of the specific reading skills, abilities, and attitudes demanded by their course, 
their assignments, or their units of work. Knowing these, they must then hold themselves account- 
able for developing these specialized abilities, or for seeing that transfer is made from other 
areas where similar skills are demanded. The statement that every teacher is a teacher of read- 
ing is no idle dictum. 


SUMMARY 


On the basis of the study described there appears to be a positive relation between the abil- 
ity to engage in a ‘‘general’’ type of reading and the ability to read in a specialized area. This re- 
lation is not so high, however, as to dismiss the possibility that a great number of pupils can prof- 
it from instruction in the specialized skills and abilities that go into reading in a particular con- 
tent area. The need for each teacher to be cognizant of the skills demanded by the area in which 
he is instructing is pointed out. Only in this way can he be sure that he is meeting children’s needs. 


Stenry E. Garrett, Statistics in Psychology and Education (New York: Longmans, Green and Co., 1940), 
Pp. 344-46, 
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THE APPEAL OF INFORMATION ABOUT OCCUPATIONS 


LESTER NICHOLAS RECKTENWALD 
Vet * Advisement Center. Inc.. New York. New York 





INTRODUCTION 


The entire experiment of which this paper treats only a part was conducted in a New Jersey 
high school in a city which is largely industrial in its vocational composition. One senior high 
school served the students. 


The subjects included were 166 twelfth grade boys. It was decided to use only this classi- 
fication of students to secure as much homogeneity as possible. It was thought, too, that informa- 
tion about occupations with which the study is, in part, concerned would be especially valuable for 
boys either about to enter vocational life or to continue their training in other institutions. 


PROBLEM 


Two problems are treated in this analysis. They may be briefly stated as follows: How 
can occupations be investigated by students in a reasonably typical educational situation? And, do 
twelfth grade boys who are interested in investigating information about occupations have charac- 
teristics different from those who are not? From the analysis, interpretations are made. 


PROCEDURE 


At the beginning of a semester, the Cleeton Vocational Interest Inventory! was administer- 
ed to the boys. Subsequently, the inventories were scored and the boys at periodic intervals were 
called into the counseling room either singly or in small groups. A brief talk was given them con- 
cerning the place of interest in choosing and planning for a suitable vocational objective. In sub- 
stance, it consisted of the following explanation. 


“Before you leave school to enter the occupational world or a higher educational 
institution, it is important that you learn about kinds of work which may be most 
suitable for you. When anyone anticipates taking an important step, he makes in- 
quiry about the venture so that he may be guided by the findings. When that step 
is concerned with such an important matter as one’s future career, the signifi- 
cance of the findings is increased. Information is available which, if intelligently 
used, may be of great value in eliminating any prejudice about an occupation 
which might be suitable in every other respect. Some of you have, no doubt, made 
your plans. If they are sound, you will be reassured regarding your decision. If 
they are not, you may be prompted to make such changes which are desirable in 
the light of the findings. 

You will be given an opportunity to explore your interests by investigating 
certain occupations suggested from the responses you gave on the inventory. It 
is hoped that the experience and the information you gain will be of benefit to you 
in guiding you in your plans for the future.”’ 


. 
“Glen U., Cleeton, The Cleeton Vocational Interest Inventory (Bloomington, Illinois; McKnight and 
McKnight, 1937); revised edition 1943. The original edition was used in this study. This inven- 
tory rather than any other was selected for a number of reasons, It was relatively new and not a 
great deal was known about its behavior. More apropos of the requirements of this particular phase 
of the whole investigation concerns its construction. It is designed sc that an area of “strongest 
interest" is segregated from other areas and liked occupations which are listed in the isolated 
category can then be readily selected for the analysis described in this paper. 
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METHOD OF INVESTIGATING OCCUPATICNS 


The first problem concerns a method of investigating occupations. Each boy was asked to 
select from his inventory, the first, second, and third? most liked occupation in that category of 
‘‘yocational interests’’ in which he had made his highest point score.3 Inspection of the markings 
revealed that three was the largest number of pluses in the high category of all the boys. A rec- 
ord of the occupations so selected was kept. Copies of a standard mimeographed outline form5 
were furnished each student and oral instructions regarding the procedure for securing the neces- 
sary information for performing the assignments were given. 


After each student had been instructed in this manner, he was called into the counseling 
room for conference several times during the semester, either singly or along with one or two 
others. The progress of each student’s work was discussed and a record of visits was noted. Dur- 
ing these visits, books, pamphlets, mimeographed material, leaflets, abstracts, and the like, apro- 
pes of the occupations selected for study were charged out to him. Reading materials were quite 
extensive, the counseling room being well stocked with both general information about occupations 
and data concerning local fields of work. 


CHARACTERISTICS OF THE BOYS 


Of the 166 boys who had started on the projects, 106 carried through the assignment to 
completion by the end of the semester. Thes?> were called Class I. Sixty boys did not complete 
the projects. These were called Class Il. The second problem is to ascertain what differences 
there were in the characteristics of the boys of the two classes. 


Average scores on the inventory. - It will be observed from Table I that Class I had the 
higher mean score (number of items marked as ‘‘liked’’). The difference between the two means 
is 3.1, significant at the 2 per cent level® The difference between the standard deviations, 1.3, is 
not significant. It appears from these data that higher scores on the inventory tended to be assoc- 


iated with greater desire for information and greater effort expended to carry the investigation to 
completion. 


Background factors. - By applying the chi-square test, no significant differences were 
found between the two classes in half-grade classification, high school course pursued, and college 


expectancy. 


“The inventory requires that only one occupation be marked as the most liked in each category. 


Sthe 1943 edition uses percentile score as a basis for estimating strength of “vocational interests". 


‘The phrase “as well as zeros in the low. . ." should be added, The study of disliked occupations, 
however, is extraneous to the scope of this paper. 


5(see end of article). 


Srhe "+" value is 2.4. 
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TABLE I 


SCORES OF STUDENTS IN CLASS I AND CLASS II 
BASED ON AVERAGES 








Frequency Percentile Rank of Score 





ClassI Class I ClassI Class I 





2 0 99 
4 1 96 99 
6 2 92 97 
22 5 78 
18 13 59 
21 13 41 
23 17 20 
8 8 
1 0 
1 1 





106 60 
35.8 32.7 








Standard Deviation 8.7 1.4 


Tabel II reveals a comparison between the two classes in age, scholastic aptitude, achieve- 
ment, and number of job experiences. The only significant difference is in academic achievement. 
Classes I had a mean 2.29 percentage points higher than Class II. This difference, yielding a ‘‘t’’ 
value of 2.76, is significant at the 1 per cent level. None of the standard deviations is significant. 


TABLE 1 











CHRONOLOGICAL AGE (IN MONTHS) 
SCHOLASTIC APTITUDE 
AVERAGE PASSING ACHIEVEMENT MARK 
NUMBER OF JOB EXPERIENCES 








Trait Class I Class II Difference’ 
M ) M 3s M 5 


Age in Months 207.08 9.38 | 205.70 10.29] 1.38 0.91 


Scholastic 
Aptitude? 106.08 9.86] 105.30 8.59] 0.78 1.27 








Achievement 10 80.92 5.26] 78.63 4.88 | 2.29 0.38 


Number of job 
experiences 2.09 1.02 2.18 1.08 | 0.09 1.06 























"Between means and between standard deviations. 


SRatio of the difference between means and its standard error and of the difference between 
Standard deviations and its standard error. 


Based on the Otis Quick-Scoring tests. The scores as shown are not the same as “intelligence 
quotients", 

10 nased on six semesters of passing work in academic subjects of the high school for IV-1 students 
and on seven semesters for .IV-2 students. 
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SUMMARY 


One hundred and sixty-six twelfth grade boys in a single high school were given the Cleeton 
Vocational Interest Inventory at the beginning of a semester. 


From the responses, certain occupations were selected about which information was 
gleaned from various sources by the students according to a standard outline form. These proj- 
ects were completed, with help, by 106 of the students. Sixty of the boys did not finish the assign- 


ment. 


The first group of boys (Class I) differed from the second (Class II) in the scores (number 
of pluses) obtained on the inventory, the former scoring significantly higher. The members of 
Class I also had made significantly higher marks in their academic subjects throughout their high 
school career. 


INTERPRETATION 


Of all possible methods, whether the most effective one was used for the study of the infor- 
mation is an important consideration. A list of possible methods would, no doubt, vary in more or 
less detail with the person proposing it, but from most concrete to most abstract methods it would 
contain essentially these: 


1. Actually performing work processes on the job. 

2. Performing simulated job experiences in school. 

3. Visiting occupational establishments and observing and talking to workers. 
4. Reading about occupations. 


5. Thinking about occupations without being in possession of most of the facts. 


Obviously, the first method could not have been used in this investigation as the boys were 
in a reasonably typical educational situation. The second, too, must be eliminated since the school 
had not set up and could not hope to set up the comprehensive try-out program necessary to en- 
compass all the vocational preferences of these students. As these methods are probably the most 
concrete, let us assume, for the moment that one or the other might have been employed. It would 
not necessarily follow that the best method for studying information about occupations had been 
utilized. True, students would learn work processes, but if this learning were not supplemented 
with other information about occupations (e.g. kind and amount of training needed, range of wages 
paid, etc.) one may well doubt that the most effective method had been employed. The third could 
be used to a limited degree for the reason that a limited number of occupations was to be found in 
the community. The fourth method, together with the outlining procedure was chosen as the most 
practical in the light of the conditions of the investigation. The literature about occupations espe- 
cially within recent years has become extensive enough to embrace facts about most of the common 
occupations. Moreover, students were encouraged to supplement their readings with information 
obtained from observing workers, and by talking to them, to parents, and to teachers. It appears, 
therefore, that the best possible method was employed. 


It seems that a more comprehensive combination of liked occupations could have been 
chosen for study. If the same inventory is used, the following combination is perhaps more ade- 
quate: three most liked occupations in the high category, two most liked occupations in the second 
high and the most liked occupation in the third high. Less likelihood of a suitable vocational es- 
caping study would obtain under this arrangement.!1 


llto provide a fully satisfactory answer to this problem would require 4 therough consideration of 
the raison d'etre of vocational interest inventories. Suffice it to say that the technique came 
into being on the theory that a sound instrument provides a more trustworthy estimate of a4 suitable 
occupation or vocational field from the standpoint of interest than the expression of a preference 
because many underlying factors are taken into account in an inventory which are associated with an 
occupation or with a worker in an occupation. 
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It appears that the teacher of occupations has a problem with respect to the motivation of 
low achievers which is little different from that of teachers of other academic subjects. The some- 
times heard opinion that ‘‘students are not interested in the study of occupations’’ is probably no 
more true than a similar opinion about other subjects. As a matter of fact, it might be less true if 
full opportunity for individualized work were taken, and it must be granted that such occasion is 
ever present in the study of vocations. It is quite likely that the projects lost some of their appeal 
for certain students because of the inclusion of most disliked occupations. Although there may be 
value in requiring that such occupations be analyzed, they should unquestionably be given less em- 
phasis. With these’eliminated for thorough study and assignments individualized according to the 
interests of students, the study of occupations could become a more significant activity. 


OUTLINE FOR THE STUDY OF AN OCCUPATION 


Student’s Name Occupation 








I. How important is the work? [lustrate. 


Il. What does the worker do? List his duties or outline a day’s work. 


Ill. What qualifications does he need? For entrance into the work? (abilities, 
character traits, physical qualifications, skills, etc., schooling, special 
training, important subjects). 


For progress in the work? 


IV. What are the conditions surrounding the work and the worker? (working en- 
vironment, people with whom he deals, earnings, etc.) 


V. What do you consider the advantages and the disadvantages in this work? 





ON ESTABLISHING NORMS IN A LARGE CITY SYSTEM 


HARRY L. STEIN* 
University of Manitoba. Winnipeg. Canada 


For the past six years there has been administered annually to all the children aged 6-10 to 
7-10 years in the City of Winnipeg, the California Test of Mental Maturity, Primary Form. Dur- 
ing the first four years the unabridged form was used, while during the 1945 administration the 
short form was used. The purpose of this paper is to study the nature of the variation among 
schools of the intelligence quotients derived from the 1945 administration, and to establish a norm 
for the school system which will be a more accurate estimate of the average intelligence quotient 
than the simple unweighted mean of the distribution. 


It is customary to have the test administered by the primary teacher in each of the forty-six 
elementary schools, and this administration is carried out with as much uniformity as it is possi- 
ble to obtain under these conditions. There is, however, a wide variation among schools in both 
means and standard deviations. Comparisons between schools, and with the population norms, 
then, must be made with due regard to this variation. 


One of the questions that arises is whether or not it is permissible to pool the results of 
schools indiscriminately in order to establish a norm for the system as a whole. To combine the 
results of individual sub-groups for statistical purposes with a view to examining them with re- 
spect to significance among their means, it is necessary first to establish whether or not the 
standard deviations are homogeneous within the groups. 


To test the assumption of the homogeneity of standard deviations or variances among schools 
we make use of the Lj test (5). The hypothesis we wish to test is that there is no significant dif- 


ference in variance among k samples of size n, and the criterion is / 
Lane)? 4{ fe} * 


where TT denotes the product, 9; denotes the within school sum of squares for the s-th school, 

and N =Ing. We then refer to Nayer’s tables of the L; distribution (3) with k = 46 and 

n = fg = [+ {x} ]° where n - 1 denotes the degrees of freedom associated with G; in 
n 


the s-th school (1). The rule to be followed is to reject the hypothesis tested at a given level of 
significance, when the calculated value of L; is less than the corresponding point given in the 
table. The basic data and the calculation of the L; test are shown in Tables I and I. 


Table I shows the frequencies, means, standard deviations, and, in deviation form, the sums 
and sums of squares for the forty-six schools upon which this study is based. Table II shows the 
calculation of the L; test for homogeneity of variance. 


Entering Nayer’s tables with the obtained L) of .897 and df. = 36 - 1 = 35, we must obviously 
reject the hypothesis that the schools are homogeneous as regards variability, and conclude that 
the heterogeneity thus established must have a distinct bearing upon the general mean of the school 
system. Because of the heterogeneity of the data it would be inefficient to set up a parameter value 
for the City as a whole on the basis of the ordinary weighted mean. 


However, because of the practical need of establishing some one norm or value, the problem 
arises as to what might be the measure of central tendency and variability for the school system 
as a whole. In other words, can we obtain an unbiased estimate which would be the best estimate 
of the average intelligence quotient for this city system ? 


*The writer is indebted to Dr. Palmer 0. Johnson, of the University of Minnesota, for his 
assistance in formulating this problem. 
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TABLE I 


FREQUENCIES, MEANS, STANDARD DEVIATIONS, SUMS AND SUMS OF SQUARES OF 
INTELLIGENCE QUOTIENTS IN FORTY-SIX SCHOOLS IN CITY OF WINNIPEG 








SCHOOL 


8. D. 


sSx’* 


s(x’ )? 





102.00 
89.05 
89.80 
95.90 
95.00 

100.33 
99.60 
88.60 
93.60 
97.70 


13.09 
14.13 
11.74 
12.11 
19.22 
12.88 
15.35 
17.68 
14.79 
17.91 


517 
327 
257 
577 
144 
256 
305 
233 
317 
537 


6009 
3070 
2367 
5989 
1604 
2890 
3481 
2289 
3253 
6121 





98.71 
99.90 
91.66 
98.66 
98.00 
92.30 
93.00 
90.66 
89.50 
96.50 


14.95 
14.39 
12.94 
12.26 
12.41 
12.64 
13.83 
15.49 
17.06 
12.49 


724 
593 


8114 
6743 
4401 
6323 
1653 
5316 
7579 
5508 
1678 
6979 





86.80 
100.25 
97.98 
92.80 
99.20 
96.41 
86.70 
96.43 
90.30 
102.60 


15.19 
13.45 
14.01 

9.35 
12.72 
14.39 
13.76 
14.21 

7.67 
14.80 


3410 
13155 
7381 
2185 
8193 
3602 
3531 
8467 
1162 
5950 





94.94 
99.96 
112.60 
97.50 
103.00 
103.40 
113.30 
95.60 
105.00 
98.40 


15.47 
13.45 
20.62 
13.81 
11.04 
10.88 
15.90 
16.67 
14.38 
10.55 


3960 
6450 
7571 
3746 
3258 
7398 
10398 
2218 
8851 
3525 








100.80 
102.20 
104.90 


16.94 
11.30 
14.06 
12.74 
12.06 
14.55 


8793 
6098 
11071 
2360 
6593 
2321 
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A method of weighting the sub-group means has been suggested by Neyman (4). This method 
has been adapted for the data in this study. Care should be taken, however, to consider the possi- 
bility that the means and standard deviations of the schools in this system are not correlated. The 
correlation between the means and standard deviations was found to be .097, which does not differ 
significantly from zero. It seemed appropriate, therefore, to make use of the method suggested by 
Neyman, of combining the means of the schools in order to take into account the variability among 
schools in frequency and the standard deviations within schools. 


The formula suggested by the work of Neyman for weighting the means of the sub-groups, and 
thereby establishing an unbiased measure of central tendency, is, using an adapted notation, as 
follows: My = 4% RK, + Nz Gy Hq +..---..+Nn On Rn 

a On 
where My is the unbiased estimate of the mean; Nj, No, ....Nn, are the frequencies of the separate 
schools; 8, 52; +++sSp, are the unbiased estimates of 0 1, 02, ....0@n, or the standard deviations of 
the schools; = Np Gp is the sum of the weighting factors in the numerator. 


For the data presented above, My = 99.38 I. Q. points. Thus the unbiased estimate of the mean 
for the system as a whole does not differ significantly from a hypothecated mean of 100 I. Q. 
points for the population of first grade children with which this study is concerned. 





An unbiased estimate of the population variance may be obtained by means of the formula sug- 
gested by Hoel (2). If k sample variances are available, 


2 2 2 
Ot. eke ae ee 


My + Ng te-+eeees Me - Kk 





where @*= the unbiased estimate of the parameter value; st, si, eee sf are the sample estimates 
of the population variance; nj, no, ...... My, are the frequencies in the respective schools. This 
formula ‘‘is particularly useful when several sets of data are available for which the variability 
can be assumed to be constant, but for which the means vary more than could be reasonably at- 
tributed to chance. If such sets of data were combined into one set and the variance of the entire 
= - as an estimate of the population variance, the result would be to over-estimate the value 
However, if one calculates the variance of each set and combines as in formula 2, the re- 


oa will be unbiased.’’(2) The unbiased estimate of the standard deviation for the data of this 
study was 14.26 I.Q. points. 

In endeavoring to establish norms on the basis of city or state-wide testing programs, the im- 
portance of testing basic assumptions before combining data cannot be overstressed. The efficient 
use of statistical tools in the solution of problems of this type is founded upon an adequate analysis 
of the data to determine the extent to which the basic assumptions are justified, and any interpre- 
tation of data thus analyzed can be fairly evaluated in the light of the revelations of the analysis. 


BIBLIOGRAPHY 


. Hartley, H. O., ‘‘Testing the Homogeneity of a Set of Variances,’’ Biometrika, XXXI (1940) 
pp. 249-255. 


- Hoel, Paul G., Introduction to Mathematical Statistics, (New York: John Wiley and Sons, 1947), 
pp. 128-130. 


- Nayer, P. P. H., ‘‘An Investigation into the Neyman and Pearson Lj Test, With Tables of 
Percentage Limits,”’ , I (London: Department of Applied Statis- 
tics, University College, 1936), pp. 38-51. 


Neyman, J., ‘‘On the Two Different Aspects of the Representative Sampling,’’ Journal of the 
Royal Statistical Society (1934), pp. 558-625. 


- Welch, B. L., ‘‘A Note on an Extension of the Lj Test,’ Stat 
(London: Department of Applied Statistics, University College, TON pp. 52-56. 





THE READING HABITS OF SUPERIOR COLLEGE STUDENTS 


RALPH C. PRESTON and EDWIN N. TUFT 
University of Pennsylvania 


This investigation aims to determine to what extent a group of college students with supe- 
rior scholarship ratings possess efficient reading habits. By efficient reading is meant the ability 
to read rapidly and with rhythmic, continuous eye-movements. Efficient reading is frequently pre- 
sumed to be necessary for successful reading and scholastic success. Thus Bowen writes: ‘‘Care- 
ful selections and rapid reading are essential to the adult who aspires to be ‘well read’ today.” 
She cites 325 to 425 words per minute as a criterion ‘‘by which to judge an individual’s (college 
student’s) rate.’”’1 Cole, in comparing the eye-movements of a good reader with those of a poor 
reader, concludes, in part, that ‘‘the good reader is good because he uses few fixations, rarely 
makes a regression, and hits the beginning of each line accurately.’’2 A manual for college stu- 
dents states: “There is a definite relationship between scholastic aptitude and reading efficiency:’? 
How definite is this relationship? 


SELECTION OF SUBJECTS 


A letter was sent to the 42 members of the junior class consisting of 206 members of the 
College for Women of the University of Pennsylvania in the second semester of the academic year 
1946-1947 who were eligible for election to Phi Beta Kappa, requesting their participation in the 
study. These were the leading 42 juniors as judged by college grades. Of these, 22 volunteered 
and constitute the subjects of this investigation. Ten of these were subsequently elected to Phi 
Beta Kappa, and it is reasonable to believe others of them will be elected in their senior year. 
Chronological ages ranged from 19 to 21 years. Average scholarship ratings were calculated for 
all of the 22 subjects, and yielded a mean of 4.4 and a standard deviation of .03 (5.0 designating 
‘*A’’, 4.0 designating ‘‘B’’, etc.). 


TESTING PROCEDURE 


The subjects were examined, singly in some cases, more frequently in pairs. The follow- 
ing tests were administered in accordance with directions appearing in the respective manuals. 


1. Towa Silent Reading Tests, New Edition, Advanced Test: Form Am, Test 1, 
Parts A and B (rate-comprehension). (World Book Co.) 


2. Traxler High School Reading Test (for Grades 10, 11 and 12), Form A, Part I 
(reading rate and story comprehension). (Public School Publishing Co.) 


- Minnesota Speed of Reading Test for College Students, Form A. (University 
of Minnesota Press) 


Study-Habits Inventory (Stanford University Press) 
Metronoscope, Roll No. 2125, ‘‘Mr. Vinegar,’’ Roll No. 2483, ‘‘Creating New 


Colors’’, and Roll No. 2485, ‘‘Little Bugs and Big Business’’. (American 
Optical Co.) 


lg, Bowen, “Speed for Today's Reading Needs ," Teachers’ Service Bulletin in Seading (New York: 
Macmillan Ca, 1946). 
2L. Cole, The Improvement of Reading (New York: Parrar & Rinehart, 1938), p. 56. 


3h, WW, Frederick, et al, A Guide to College Study (New York: Appleton-Century Co., 1947), p. 81. 
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6 ph, High School and College, Forms A and D. (American 


: Optical Co.) 


The first three tests listed are paper-and-pencil tests of silent reading. It should be 
pointed out that the Minnesota Speed Test is a test of comprehension as well as speed. It consists 
of a series of brief unrelated paragraphs, so that a score in terms of words per minute (appropri- 
ately calculated only where extended, continued reading matter is presented) cannot properly be 
derived. 


The fourth test is a short self-rating inventory of selected study habits. 


The fifth test employs a machine into which rolls containing factual reading matter are in- 
serted. Through a shutter arrangement, one phrase is exposed at a time. The speed of exposure 
is regulated by a dial. It is ordinarily used as a pacing device to assist in speeding up reading. A 
comprehension test has been prepared for each roll consisting of ten questions about equally di- 
vided between completion items and alternative-response items. Rolls were used in the order 
listed above. The first roll, consisting of comparatively simple reading matter, was used for prac- 
tice and was not followed by a test. The second roll was run at the rate of 300 words per minute 
and the third roll at the rate of 367 words per minute. Comprehension tests followed in both in- 
stances. These two rolls were judged to possess equal complexity and were deemed appropriate 
for subjects of high intellectual caliber. 


The sixth test was administered twice with two different reading selections. The subjects 
sat before a camera equipped to photograph eye-movements, read a short selection, then answered 
ten true-false questions. Two usable reading graphs were obtained for each of 17 subjects and one 
was obtained for each of the remaining 5 subjects. 


SPEED OF READING 


Words per minute. - Table I presents the distribution of the 22 subjects according to their 
speed of reading. In connection with any of the tests less than half of the subjects read faster than 
$25 words per minute. Bowen, as already mentioned (reportedly basing her figures on eight 
studies), gives a range of from 325 to 425 as typical of the rate for college students.4 





TABLE I 
DISTRIBUTION OF SUBJECTS ACCORDING TO RATE OF READING UPON FOUR TESTS 


Words per minute lowa Traxler OphthalmographI Ophthalmograph I 


500-524 
475-499 
450-474 
425-449 
400-424 
375-399 
350-374 
325-349 
300-324 
275-299 
250-274 
225-249 
200-224 
175-198 
150-174 
125-149 
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TABLE I 


INTERCORRELATIONS BETWEEN MEASURES OF SCHOLARSHIP, READING SPEED, 
EYE MOVEMENTS, STUDY HABITS, AND READING COMPREHENSION 


Traxler speed 
Minnesota speed and 
comprehension 


Ophthalmograph speed I 


Ophthalmograph speed I 


Span of recognition I 

Span of recognition II 

Regressions I 

Regressions II 

Study habits 

Iowa comprehension 

Traxler comprehension 

Metronoscope compre- 
hension I 

Metronoscope compre- 
hension II 


Accuracy of comprehension 


(Iowa & Traxler) 
Scholarship 


Traxler speed 


Minnesota speed and 


comprehension 
Ophthalmograph 


speed II 
hension I 


speed 1 
Opthalmograph 


Span of recognition I 
Span of recognition I 
Traxler comprehension 
Metronoscope compre- 


Regressions I 
Iowa comprehension 


- .46 
35 

06 .42 -.27 
ll = .36 .22 
01 -.26 .08 


00 -.27 -.07 .23  .05 -.01 


00 -.58 .00 .14 -.12 -.13 
-.10 .03 .25 .75 .01 


20 .00 .01 .24 .49 


Metronoscope compre- 
henaion I 
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Two of the subjects exceeded 325 words per minute upon the first ophthalmograph selec- 
tion, and eleven exceeded that rate upon the second ophthalmograph selection. The, manufacturers 
of this instrument give 325 words per minute as the norm for college students.5 Reference should 
be made in passing to a fact pointed out by others, namely, that the standard ophthalmograph selec- 
tions do not yield reliable measures of rate. The reading of the second ophthalmograph card in- 
creased an average of 28.8 words per minute over the reading of the first card. The standard 
error being 14.9 words per minute, the difference is highly significant. There is less than one 
chance in a hundred that such a difference would occur if the first and second readings were simi- 


lar experiences. 


Percentile scores, - The most suitable available norms in studying college juniors for the 
lowa, Traxler, and Minnesota tests are based, respectively, on performance of college freshmen, 
high school seniors, and college juniors. The number of subjects with scores above the 50th per- 
centile in terms of rate derived from these most nearly appropriate norms were tabulated and, to- 
gether with the range of percentile scores of all students, are summarized below: 


Test Range of percentile scores Number of students out of 22 


(all subjects) exc 50th percentile 
lowa 4-99 15 
45-99 21 





Minnesota 15.48-97.62 17 


In examining these figures, it must be borne in mind that the criteria are based upon the 
performance of younger and less experienced students with the exception of those used in connec- 
tion with the Minnesota test. It should again be noted that the Minnesota scores measure compre- 


hension as well as speed. 


Effect upon comprehension of forced increase ip speed, - After the practice run of a me- 
tronoscope roll, a roll was exposed at the speed of 300 words per minute and the comprehension 
test given, then the second roll was run at the increased speed of 367 words per minute, again 
followed by a test of comprehension. 


The comprehension score of 14 of the 22 subjects dropped when the speed of presentation of 
the reading matter was thus increased. Comprehension scores decreased by a mean score of 1.2. 
Since the standard error is .35, the difference between the means of the two sets of comprehension 
scores is not statistically significant. 


Sum: . - This group of students read, in general, an average of between 300 and 350 
words per oo with approximately one-fifth of them reading above 400 words per minute and 
approximately another fifth reading below 250 words per minute. Roughly between one-ninth and 
one-third failed to exceed median speeds of high school seniors, college freshmen, and college 
juniors. Forcing the rate of reading to 367 words per minute resulted in loss in comprehension of 
over half of the subjects. While this loss in comprehension is not statistically significant, one is 
cautioned against generalizing that the reading speed of superior students possesses common char- 
acteristics or that it can be judged by an arbitrary standard. 


EYE MOVEMENTS 


Analysis of the graphs resulting from the photography of eye movements yields the follow- 
; First test Second test 

Range Range Mean 
Span of recognition (words)  .85-1.67 1.28 -83-2.08 1.35 


Number of regressions 2-46 13.40 0-42 11.58 


‘The Ophthalmograph, The t) ope: Manual for Controlled Reading (Southbridge, Massachusetts: 
American Optical Co., 1937), p. 27. 
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The manufacturers of the ophthalmograph (American Optical Co.) give 1.25 words per fixation as 
the norm for college students and 10 regressions per 100 words as the norm for college students $ 
The means for the group are slightly above these norms. One-half of the subjects achieved the 
norm with respect to eye-span on the first test, and slightly less than two-thirds achieved it on the 
second test. One-half met or exceeded norms with respect to regressions on the first test, and 
slightly less than one-half met or exceeded the norms on the second test.7 


Further information concerning the subjects’ regressive tendencies was provided by their 
responses to the Study-Habits Inventory item: ‘‘I have to reread material several times--the 
words don’t have much meaning the first time I go over them.”’ Eight subjects responded ‘‘rarely 
or never”, ten responded ‘“‘sometimes’’, and four responded ‘‘often or always’’. 


Summary. - The distribution of the subjects according to their eye movements while read- 
ing shows a — spread of practice centering somewhat above norms established for college 


students. 
PRONOUNCING WORDS IN SILENT READING 


Pronunciation of words is an obvious deterrent both to speed and rhythm of silent reading. 
In responding to the Study-Habits Inventory item: “I pronounce the words to myself as I read’’, 
12 subjects checked ‘‘rarely or never’’, 7 checked ‘“‘sometimes’’, and 3 checked ‘‘often or always’’. 
The ophthalmograph films supply no evidence of lip-reading. What pronunciation takes place is 
doubtless occasional or, where frequent, of a suppressed nature. 


Summary. - Pronunciation of words, so commonly associated with immature reading, is 
claimed as a consistent trait by about one-seventh of the subjects. 


STUDY HABITS 


Analysis of responses to the Study-Habits Inventory reveals considerable homogeneity, 
particularly in the following characteristics which are claimed by all but two subjects: 


Does not often have trouble in picking out the important points in material read or 


studied. 
Does not often have trouble in concentrating, avoiding day dreaming, or getting 


‘*warmed up’’ in the study process. 


The author of the Inventory, Dr. C. Gilbert Wrenn, has kindly furnished information con- 
cerning the distribution of scores of the Inventory in its use among high scholarship students at 
Nebraska State Normal College. A comparison of measures follows: 


Quartile Nebraska State Normal Subjects of this study 
h scholar- 

Q3 64 89 

Q2 (median) 46 14 

Qi 23 39 


All except two subjects (these two scored below the published mean score of 15 for college fresh- 
men) of this study scored considerably above the first quartile figures established by the Nebraska 
data. 


Summary. - The Study-Habits Inventory scores show a wide range, but with two exceptions, 


Les. sit, 


Tt. exceed the norm, @ student must make a fewer number of regressions than ten per 100 words. 
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all scores are high. Ability to pick out important points in reading and ability to concentrate were 
the two traits attributed to themselves most unanimously by the subjects. 


COMPREHENSION 
Comprehension is an obvious function of reading efficiency and will be treated briefly. 


Percentile scores. - Comprehension percentile scores upon the Iowa test ranged from 30 
to 99 and upon the Traxler test from 21 to 97. As in the case of percentile scores of rate, these 
are based on norms for college freshmen and high school seniors respectively. Thirteen of the 22 
subjects scored above the Iowa median, and 15 scored above the Traxler median. 


ccuracy. - Percentages of accuracy upon all attempted comprehension items in the Iowa 
and Traxler tests range from 55 to 95. Assuming that an efficient reader grasps more than 75% 
of items attempted in carefully constructed tests such as these two, nine of the 22 subjects may be 
considered good readers when judged by such a standard. Twelve achieved or exceeded this stand 
ard on the metronoscope tests (averaging the scores of the two tests for each subject), and twelve 
also achieved or exceeded this standard on the ophthalmograph tests (again averaging the scores 
of the two tests for each subject). 


Summary. - The wide spread among the subjects already reported with respect to rate is 
found also with respect to comprehension. Aside from a somewhat greater preponderance of very 
high scores, the distribution is not totally dissimilar to what might be expected from an unselected 
group of juniors attending a college with high standards of scholarship such as that attended by 
these subjects. j 


INTERCORRELA TIONS 


Table II presents intercorrelations (derived from the Product-Moment formula) between 
the various measures employed in the study. Aside from a fair degree of relationship between 
number of regressive eye movements and span of recognition (-.46 to -.96), consistent and 
strong relationships do not appear. Correlations between the various measures of comprehension 
and the various measures of reading efficiency are low (.00 to .58 with a median of 10.5). 


Interpretation of the low correlations of measures with scholarship ratings must be made 
in the light of the high degree of homogeneity of the group with respect to scholarship--the basis 
on which the group was selected. Traxler comprehension scores correlate more closely with 
scholarship ratings than do any other scores (.49), followed closely by the Minnesota score which 
is based on comprehension and speed (.42). 


OPINIONS OF THREE SUBJECTS ABOUT THEIR SLOW READING 


Opinions were solicited by questionnaire from the seven ‘‘least efficient’’ readers among 
the subjects. Four replied, three of whom acknowledged their reading to be inefficient. All three 
testified they have felt handicapped as college students by their inability to read more rapidly, 
and that they would have welcomed as underclassmen an opportunity for receiving instruction in 
developing more efficient reading. All three of these slow-reading subjects stated, on the other 
hand, that they felt their leisurely habits of reading had enabled them to ‘‘absorb’’ and compre- 
hend more content with a single reading than would be possible under conditions of rapid reading. 
One of the subjects testified it was possible ‘‘to retain material read this way for a longer period 
of time.’’ Another stated: ‘It seems that one has more time (with slow reading) to correlate the 
things already learned with the new material in the reading.’’ Despite the informal and sketchy 
nature of these opinions, they are not without relevance and importance. 


CONCLUSIONS AND COMMENT 
The evidence does not support the view that successful college students are uniformly 


efficient readers. Less than half of the group read faster than 325 words per minute (frequently 
and probably mistakenly cited as a norm for college students); one-half to two-thirds of the 





